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EXPERIMENT DESIGN SESSION 


N ASA-S-78-1 6796 

EXPERIMENT DESIGN SESSION 


• EXPERIMENT DESIGN - ITS ROLE IN LAC IE 

• LAC IE DID HAVE A COHERENT DESIGN APPROACH - 
TENDENCY WAS ALONG CLASSICAL LINES 

- SUPPORTED ADVANCING THE TECHNOLOGY TO A 

LEVEL READY FOR INCLUSION IN A FUTURE 
OPERATIONAL SYSTEM 

- LAC IE DESIGN STRUCTURED AN EXPERIMENTAL 

SYSTEM WITH MECHANISMS FOR: 

• IDENTIFYING THE STATE-OF-THE-ART TECHNOL- 

OGY (FROM ESTABLISHED PROCEDURES) TO 
PERMIT CROP INVENTORYING USING SATELLITE 
AND METEOROLOGICAL BASED DATA 

• PERFORMING NECESSARY TESTS AND EVALUATIONS 

TO ASSIST IN DETERMINING WHAT THE STATE-OF- 
THE-ART PROCEDURES ARE AND HOW THEY PER- 
FORM 

• SUBJECTING THE OVERALL DESIGNED SYSTEM TO 

A QUASI-OPERATIONAL ENVIRONMENT FOR FINAL 
PERFORMANCE ASSESSMENTS AND SUBSEQUENT 
REFINEMENTS/IMPROVEMENTS 


3 


JBAGE oJZ- 


intentjonillk BLANK 





NASA-S-78-1 6797 

THE LARGE AREA CROP INVENTORY EXPERIMENT 


EXPERIMENT ELEMENTS 

OBJECTIVES > 

PARTICIPANTS » 

AVAILABLE 

TECHNOLOGY * 
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FACILITIES * 

USER 

REQUIREMENTS 

SATELLITE/SENSOR 

CAPABILITIES 


EXPERIMENT DESIGN USER 


• TECHNICAL/ 

SYSTEM 

DESIGN 

• SCOPE 

• SCHEDULE 

• MANAGEMENT 

STRUCTURE 
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• DOCUMENTA- 

TION 


EVALUATION 
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SYSTEMS 
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EXPERIMENT DESIGN SESSION OVERVIEW 

• LAC IE TECHNICAL COMPONENT DESIGN 

• SEPARATE METHODOLOGIES DEVELOPED IN LAC IE FOR 
AREA AND YIELD ESTIMATION 
- RATIONALE 

• PREDOMINATELY DICTATED BY EXISTING TECHNOLOGY 
- YIELD AND CROP ID ESTIMATION TECHNOLOGIES HAD 
BEEN DEVELOPED AS SEPARATE ENTITIES - THE 
TECHNOLOGY FOR ESTIMATING PRODUCTION DIRECT- 
LY FROM REMOTELY SENSED AND METEOROLOGICAL 
DATA WAS NONEXISTENT 

- TEST AND EVALUATION EFFORTS FOR IMPROVING 
EXISTING TECHNOLOGIES WERE MOST EFFICIENTLY 
SUPPORTED BY KEEPING AREA AND YIELD SEPARA- 
TED 

• HISTORICAL AREA AND YIELD DATA AVAILABLE 
ONLY AS SEPARATE ENTITIES 


N ASA-S-78-1 6828 

EXPERIMENT DESIGN SESSION OVERVIEW 

• LACIE TECHNICAL COMPONENT DESIGN (CONT) 

• AREA ESTIMATION SUPPORTED BY: 

- SAMPLING AND AGGREGATION COMPONENT - PRIMARY 

RESPONSIBILITY: DESIGN FOR SAMPLING AND AGGRE- 
GATION SCHEME 

- CLASSIFICATION AND MENSURATION COMPONENT - 

PRIMARY RESPONSIBILITY: DESIGN FOR MENSURA- 
TION OF WHEAT IN SAMPLING UNITS 

- CROP DEVELOPMENT STAGE ESTIMATION COMPONENT - 

PRIMARY RESPONSIBILITY: SUPPORT DEVELOPMENT 
OF ANALYST AIDS 

• YIELD ESTIMATION COMPONENT - PRIMARY RESPONSIBIL- 

ITY: DESIGN FOR MODEL SELECTION AND OPERATION 

• PRODUCTION ESTIMATED BY COMBINING AREA AND YIELD 

ESTIMATES 

- ACCURACY ASSESSMENT COMPONENT - PRIMARY 
RESPONSIBILITY: DESIGN FOR EVALUATING THE 
PERFORMANCE OF AREA, YIELD, AND PRODUCTION 
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COMPONENT DESIGN RESPONSIBILITIES (CONT) 
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COMPONENT DESIGN RESPONSIBILITIES 
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SAMPLING AND AGGREGATION IN LAC IE 
C Hallum, JSC 
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INTRODUCTION: CROP INVENTORY - 

A STATISTICAL SURVEY 

• CROP INVENTORY EFFORTS - HEAVILY RELIANT ON 
SAMPLE SURVEY METHODOLOGY 

• RATIONALE 

- ACCURACY AND EFFICIENCY 

- A STRONG DEMAND FOR BREADTH AND TIMELI- 

NESS OF COVERAGE 

- RECENT ADVANCES IN SAMPLE SURVEY 

METHODOLOGY 

• TWO BASIC QUESTIONS ARISE 

- HOW TO SELECT THE "PART" FROM THE "WHOLE" 

- HOW TO GENERALIZE FROM THE SELECTED "PART" 

TO THE "WHOLE" 

• OVERALL PROBLEM - FIND THE COMBINATION OF 

SELECTION AND ESTIMATION PROCEDURES THAT 

- MAXIMIZES EFFICIENCY 

- ENSURES A SPECIFIED ACCURACY 
-FOR A FIXED COST 
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INTRODUCTION: CROP INVENTORY - A 

STATISTICAL SURVEY 

• UNTIL RECENT EFFORTS OF SRS AND LAC IE, THE PRE- 
DOMINANT METHOD OF ESTIMATION HAS BEEN ONE 
INVOLVING THE USE OF MAILED INQUIRIES 

• LAC IE WAS FIRST ATTEMPT TO SURVEY AN IMPORTANT 
CROP (WHEAT) ON A LARGE (QUASI-G LOBAL) SCALE 
AT REPEATED INTERVALS OVER A WIDE RANGE OF 
CONDITIONS 

- EMPHASIS WAS ON MORE TIMELY AND ACCURATE 
ESTIMATES OF FOREIGN WHEAT AREA, YIELD, 
AND PRODUCTION ON A SCHEDULED BASIS 
THROUGHOUT THE GROWING SEASON 


N ASA-S-78-1 6836 

INTRODUCTION: CROP INVENTORY — A- 

STATISTICAL SURVEY 

• QUEST IONS' AWAITING ANSWERS AT THE OUTSET OF 
LAC IE INCLUDED 

• CAN A SAMPLING STRATEGY FOR ACQUISITION OF 

LANDSAT DATA BE DESIGNED TO ACHIEVE THE 
REQUIRED ACCURACIES WITH A MANAGEABLE 
DATA LOAD? 

• HOW CAN THE GEOGRAPHIC WHEAT DISTRIBUTION 

BEST BE DETERMINED TO EFFICIENTLY SAMPLE? 

• WHAT SHOULD BE THE CONFIGURATION AND GEO- 

GRAPHICAL EXTENT OF THE PSU TO EFFICIENTLY 
SUPPORT A PRESELECTED ACCURACY AND YET BE 
COST-EFFECTIVE? 

• DOES LOSS OF SEGMENT ACQUISITIONS DUE TO CLOUD 

COVER CAUSE EXCESSIVE ERRORS, SUCH AS BIAS? 
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INTRODUCTION: CROP INVENTORY - A 

STATISTICAL SURVEY 

• RATIONALE FOR INITIAL DESIGN 

• WOULD PERMIT U S. TO BE USED AS A "YARDSTICK” 

AND FOR R&D 

• METHODOLOGY FOR USING LANDSAT IMAGERY AND 

AGROPHYSICAL DATA WAS NOT SUFFICIENTLY 
DEVELOPED AT START OF PHASE I TO SELECT STRATA 
ALONG NATURAL BOUNDARIES 

• WOULD -PROVIDE DATA OF SUFFICIENT QUANTITY AND 

QUALITY TO MEET REQUIRED PERFORMANCE LEVELS 
AND ALSO SATISFY THE EXISTING CONSTRAINTS 

• THE ALLOCATION SCHEME APPEARED TO PROVIDE THE 

MOST EFFICIENT UTILIZATION OF DATA AVAILABLE 

- APPEARED TO GIVE BETTER SEGMENT COVERAGE OF 

MAJOR PRODUCING AREAS 

- IMPROVED THE PROBABILITY OF AN ACCURATE 

ESTIMATE 
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INTRODUCTION: CROP INVENTORY - A 

STATISTICAL SURVEY 

• RESTRICTIONS ON LAC IE DESIGN 

• USE ONLY DATA RELIABLY AVAILABLE IN FOREIGN 

AREAS (E.G , LANDSAT IMAGERY, DATA FROM MET 
STATIONS, NOAA SATELLITE DATA, AND PUBLISHED 
HISTORICAL DATA) 

• GODDARD'S REGISTRATION ACCURACY WAS ±1 PIXEL 

FOR AREAS NO LARGER THAN 25 Ml ON A SIDE 

• THE VOLUME OF LANDSAT DATA THAT COULD BE 

STORED AND PROCESSED 

• LANDSAT DATA WERE NOT AVAILABLE IN PHASE I 

FOR USE IN SAMPLING FRAME GENERATION 

• CLOUD COVER 

• OTHER LAC IE SAMPLE DESIGN CHARACTERISTICS 

• CONCENTRATION WAS INITIALLY INUSGP WHEAT- 

GROWING REGIONS WHERE RELIABLE, INDEPENDENT 
SURVEY ESTIMATES AND GROUND TRUTH WOULD BE 
AVAILABLE 

• 4800 SEGMENTS WERE DIVIDED AMONG THE U.S AND 

SEVEN OTHER COUNTRIES 
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SAMPLING, ESTIMATION, AND AGGREGATION FOR AREA 

• CONFIGURATION AND GEOGRAPHICAL EXTENT OF SAM- 
PLING UNIT 

• RECTANGULAR IN SHAPE AND 5 BY 6 N Ml IN SIZE 

• RATIONALE 

- SUPPORTED ANALYSTS' NEEDS 

• SUFFICIENTLY LARGE TO PROVIDE THE ANALYST 

WITH A GOOD PERSPECTIVE OF THE SPATIAL AND 
TEXTURAL CHARACTERISTICS OF CROPS WITHIN 
A GIVEN LOCALITY 

• SUFFICIENTLY LARGE TO GIVE ANALYSTS A GOOD 

CHANCE OF SEEING THE VARIOUS CROPS OCCUPY- 
ING A SIGNIFICANT PORTION OF THE SCENE 

- PERMITTED REQUIRED SAMPLING PRECISION WITHOUT 

CREATING UNMANAGEABLE DATA LOAD 

- ENGINEERING CONSTRAINTS 

• GSFC HARDWARE/SOFTWARE RESTRICTIONS SUP- 

PORTED THE HANDLING OF NOT MORE THAN 4800 
SEGMENTS - DICTATED A SAMPLE SIZE OF APPROX- 
IMATELY THAT SELECTED 

• GSFC COULD REGISTER TO WITHIN ± PIXEL FOR AREAS 

NO LARGER THAN 25 Ml ON A SIDE 

- RECTANGULAR SHAPE PARTICULARLY AMENABLE FOR 

COMPUTER STORAGE AND MANIPULATION 
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RELATIONSHIP OF SAMPLING FRAME TO A STRATUM 


-STRATUM 

BOUNDARY 

- PSEUDO 
STRATUM 
BOUNDARY 



NON-AG 


SEGMENTS EXCLUDED FROM 
SAMPLING FRAME 

SAMPLE SEGMENTS 
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CHRONOLOGY OF ALLOCATION OF SEGMENTS 


WORLDWIDE 
ALLOCATION 
OF 4800 
SEGMENTS 


• 637 TO U.S. 


• 411 TO USGP 



-® EXCESSIVE SAMPLING 

ERROR IN N. DAKOTA- 
\ 20 SEG ADDED 

• 487 ALLOCATION TO 
^ USGP TO SUPPORT 

SECOND-GEN STRATEGY- 


• REVISED ALLOCA- j 

TION OF 601 
SEG TO USGP 

• RELOCATION OF 

UIS.S.R. SEG DUE 
TO IMPROVED 
SAMPLING FRAMES - 


• REVISED ALLOCATION TO , 
U.S.S.R.- REDUCED / 
FROM 1947 TO 1111 — ' 
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AREA ESTIMATION 
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PRODUCTION ESTIMATION FROM SAMPLING 


COUNTY 

ESTIMATE OF AREA, 
YIELD . AND PRODUCTION 


AREA 

SEGMENT 

WHEAT 

PROPORTION 




YIELD 

METEOROLOGICAL 

STATIONS 




YIELD 

STRATUM 
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AGGREGATED AREA STRATUM x YIELD STRATUM = PRODUCTION STRATUM 
PRODUCTION USQp = E PRODUCTION STRATUM 
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AREA VARIANCE ESTIMATION 

• U.S.S.R. (STRATA-LEVEL COUNTRY) 
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SPECIAL SAMPLING AND 
AGGREGATION PROBLEMS ENCOUNTERED 

• CONSIDERABLE EFFORT WAS REQUIRED TO ESTABLISH 

DEGREE TO WHICH ALL ASSUMPTIONS ARE SATISFIED 

• RESULTS FROM INITIAL SAMPLING STRATEGY DID NOT 

ADEQUATELY INDICATE PERFORMANCE LEVELS IN 
FOREIGN AREAS 

• CROP TYPE ESTIMATION IN MIXED WHEAT AREAS 

• NONRESPONSE DUE.TO CLOUD COVER 

• CLASSIFICATION AND YIELD PREDICTION BIAS 

• INSTABILITY OF GROUPIE RATIOS 

• POOR ESTIMATION OF GROUP II "SIZES" 

• POOR QUALITY SEGMENT-LEVEL ESTIMATES 


NASA-S-78-16850 

SUMMARY 

• THE LACIE SAMPLING STRATEGY SUPPORTS THE FACT 
THAT A GOOD SAMPLING STRATEGY IS OF PARAMOUNT 
IMPORTANCE TO HAVING A COST-EFFECTIVE SYSTEM 

• CURRENT TECHNOLOGY PERMITS A SAMPLING ERROR 

OF APPROXIMATELY 2 PERCENT TO BE ACHIEVED BY 
SAMPLING APPROXIMATELY 2 PERCENT OF THE 
SAMPLING FRAME 

• THE GUIDING PRINCIPLE OF THE LACIE SAMPLING DESIGN 

WAS ONE ENDEAVORING TO MAXIMIZE EFFICIENCY 
FOR A FIXED COST 

• THE LACIE SAMPLING SCHEME ENDEAVORED TO PROVIDE 
• THE MOST EFFICIENT UTILIZATION OF EXISTING DATA 

• TECHNOLOGY TO UTILIZE LANDSAT AND AGROMET DATA 

TO PERFORM A STRATIFICATION ALONG NATURAL 
BOUNDARIES 
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EXPERIMENT DESIGN SESSION •; 


GROWTH STAGE ESTIMATION , 
V. Whitehead, JSC 
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GROWTH STAGE 
ESTIMATION 
SYSTEM DESIGN 


N ASA-S-78-1 6852 

GROWTH STAGE ESTIMATION 
SYSTEM DESIGN 

• WHY NEEDED' 

• SELECTION 4 

• SHORTCOMINGS OF SELECTED 

MODELS 

• CHARACTERISTICS 

• BASIC MODEL 

• DORMANCY 

• starter 

• RESULTING SYSTEM DESIGN 
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LACIE ADJUSTABLE CROP CALENDARS 

GENERAL BACKGROUND 

• VARIATION IN SEASONAL WEATHER'CONDITIONS CAUSE 

YEAR-TO-YEAR AND SPATIAL SHIFTS IN PROGRESSION 
OF CROP DEVELOPMENT WHICH MUST BE ACCOUNTED 
FOR TO ALLOW: 

• ACCURATE INTERPRETATION' OF LANDSAT IMAGERY 

BY LACIE ANALYSTS 

• ADJUSTMENT OF BIOWINDOW ACQUISITIONS TO MINIMIZE 

LANDSAT DATA REQUIREMENTS * 

• INCORPORATION INTO IMPROVED YIELD MODELS 

• SIGNATURE EXTENSION IMPLEMENTATION 

OBJECTIVE 

• THE OBJECTIVE OF THE CROP CALENDAR DEVELOPMENT IS 

TO PROVIDE OPERATIONAL SUPPORT TO ALL APPLICABLE 
LACIE SUBSYSTEMS BY ADJUSTING CURRENT-YEAR CROP 
CALENDARS AS REQUIRED DURING THE GROWING SEASON, 
UTILIZING SYNOPTIC METEOROLOGICAL DATA ON A DAILY 
BASIS IN A CROP CALENDAR MODEL 


NASA-S-78-1 6854 

NORMAL CROP CALENDARS 


• PROVIDE A USEFUL DESCRIPTION OF HOW CROP STAGE OF 

DEVELOPMENT VARIES OVER LARGE AREAS 

• PROVIDE A USEFUL DESCRIPTION OF RELATIVE STAGE OF 

DEVELOPMENT BETWEEN DIFFERENT CROPS IN A GIVEN 
LOCATION _ 

• DO NOT ACCOUNT FOR YEAR-TO-YEAR CHANGES 

EXAMPLE: STANDARD DEVIATION FOR ONE CRD IN OKLA- 
HOMA 

PLANTING -15 DAYS SOFT DOUGH- 10 DAYS 

EMERGENCE - 15 DAYS RIPE - 8 DAYS 

JOINTING -13 DAYS HARVEST - 8 DAYS 

HEADING - 7 DAYS 
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CROP CALENDAR 

SOUTH DAKOTA 

CROP REPORTING DISTRICT 10 
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SEEDBED PREP AND PLANTING 

POSTHARVEST OPS 

FULL COVERAGE 

DORMANCY 

Mm HEADING 

m INTERMEDIATE GROWTH 

HARVEST 

M LAST YEAR’S STUBBLE 
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PHENOLOGICAL MODELS 

• DEFINITION: MATHEMATICAL PROCEDURE FOR CALCU- 

LATING DATES OF CROP DEVELOPMENT EVENTS BASED 
ON IN-SEASON ENVIRONMENTAL CONDITIONS 

• GENERAL CONSTRAINTS: 

• UTILIZE ROUTINELY AVAILABLE AGROMETEOROLOGICAL 

DATA (TEMPERATURE, PRECIPITATION, WHEAT TYPE, 
ETC.) 

• FREE OF LOCATION SPECIFIC FUNCTIONS OF WEATHER 

VARIABLES 

• FLEXIBLE FOR EASY UPGRADING 
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PHENOLOGICAL MODELS (CONT) 


• MODELS AVAILABLE: 

• HEAT UNIT 

• PHOTOTHERMAL UNIT 

• ROBERTSON TRIQUADRATIC 

WHERE 


R = f(T) 

R = f(T.L) 

R = V 1 (V 2 + V 3 ) 

R = DAILY RATE OF DEVELOP- 
MENT AS FRACTION OF 
INTERVAL BETWEEN 
STAGES 

T = TEMPERATURE 
L = DAY LENGTH 
V 1 = a^L-ag) + a 2 (L-a 0 ) 2 

V 2 = b-|(T x -bg) + b 2 (T x -bg ) 2 
V 3 = C-|(T N -Cg) + C 3 (T N -Cg ) 2 


NASA-S-78-16857 

MODEL SELECTION 

RATIONALE FOR SELECTION 
OF ROBERTSON MODEL 

• EMPIRICAL AND THEORETICAL EVIDENCE OF NON- 

LINEAR RESPONSES TO TEMPERATURE AND 
DAYLENGTH 

• NUMBER OF PHASES AND RELATIVE INTERVAL 

LENGTHS IN THE CORRESPONDING SCALE 

• PRELIMINARY SUCCESS OF THE COEFFICIENT SET 

FOR WINTER WHEAT 

• TEST RESULTS (BMTS AVERAGE 28 PERCENT AND 

14 PERCENT BETTER THAN THE HEAT UNIT AND 
PHOTOTHERMAL MODELS BETWEEN EMERGENCE 
AND HEADING) 
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MODEL SELECTION (GONT) 

DISADVANTAGES 

• DATA REQUIREMENTS (MAX AND MIN TEMPERATURE 

WERE NOT ROUTINE IN THE NMC/WMO DATA BASES) 

• JOINTING STAGE BASED ON OBSERVATIONS ON DIS- 

SECTED PLANTS 

• PERIOD OF VEGETATIVE GROWTH BEFORE DORMANCY 

AND THE HANDLING OF DORMANCY POSED DEFINITE 
PROBLEMS 

• COEFFICIENTS DERIVED FOR SPRING WHEAT VARIETY 

USED IN CANADA 

• STARTUP PROCEDURES NOT DEFINED 
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DORMANCY ADJUSTMENT 

TO APPLY THE ACC TO WINTER WHEAT, FEYERHERM (1976) 
DEVELOPED MODIFICATIONS WHICH REFLECT THE EFFECT 
OF DORMANCY ON WINTER WHEAT. EACH DID FROM THE 
EMERGENCE TO THE HEADING STAGE IS MULTIPLIED BY A 
FACTOR CALCULATED FROM THE FOLLOWING EQUATION: 

M = 0.5684 + 0.025081 (ADTJ) - 0.006139 (AAPR) 

WHERE M = FEYERHERM'S MULTIPLIER 

ADTJ = NORMAL AVERAGE DAILY TEMPERATURE FOR 
JANUARY 

AAPR = NORMAL ANNUAL PRECIPITATION 

THIS MULTIPLIER WAS DERIVED FOR WINTER WHEAT VAR- 
IETIES TYPICALLY PLANTED IN THE U.S. GREAT PLAINS 
DURING THE EARLY 1970's 
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STARTERS USED 

e REPORTED PLANTING DATE 

• END-OF-DORMANCY ESTIMATE (WINTER) 

• FEYERHERM (SPRING) 

• STUFF AND PHINNEY (SPRING) 

• NORMAL PLANTING WITH DORMANCY MULTI- 

PLIER (WINTER) 


NASA-S-78-1 6863 


DAY LENGTH VERSUS MINIMUM TEMPERATURE 
CLIMAGRAPH FOR DODGE CITY, KANSAS 

16 r 

JUNE 


DAY 

LENGTH, 

HR 12 


OCT 

END 


NOV 

DEC V''-. 


BEGINNING 


20 30 40 50 60 

MINIMUM TEMPERATURE, °F 
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NASA-S-78-1 6864 


SPRING WHEAT STARTER MODEL 

WORKDAY MODEL (FEYERHERM) 

THE I th CALENDAR DAY IS EITHER A NONWORKDAY, A PARTIAL 
WORKDAY, OR A WHOLE WORKDAY - 


W ( = 0 


= {0 1){TA,-32) + S | 

= 1-8, 


TA, j£32°F 
32°<TA, ^42° F 
TA, > 42° F 


WHERE 8, = 1 IF ALL THE FOLLOWING PRECIP CONDITIONS ARE 
MET 

PRECIPITATION ON DAY i < 0 005(TA, - 32) + 

CUMULATIVE PRECIP ON DAY (i -1) AND i < 0 015{TAj - 32) + 

CUMULATIVE PRECIP ON DAYS (i • 2), {i - 1), AND i < 0 025{TA, - 32) + 
CUMULATIVE PRECIP ON DAYS (i - 3), (i - 2), {■ - 1 ) AND i < 0.035(TA, - 32) + 
AND 8, = 0 IF ONE OR MORE OF THE PRECEDING CONDITIONS FAIL TO 
HOLD 

TA- = DAILY AVERAGE TEMPERATURE ON DAY i (MEAN OF DAILY 
MIN AND MAX), 

(TA, - 32) + =0 I F TA, < 32 

= (TA, - 32) IF TA, > 32 


NASA-S-78-16865 


SPRING WHEAT STARTER MODEL (CONT) 

STUFF AND PHINNEY MODEL 

R = -0.77 + 0 045 (T) - 0.032{P) - 0.053(N) 

WHERE T = AVERAGE DAILY TEMP (°F) P = TOTAL DAILY 
PRECIP (IN) 

N * NORMAL PLANTING DATE - ACTUAL DATE, AND 
R = RATE OF PLANTING 
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SYSTEM DESIGN 


N ASA-S-78-1 6866 
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EXPERIMENT DESIGN SESSION 


N79-14462 


WHEAT YIELD MODEL DEVELOPMENT 
C. Sakamoto, NOAA 
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N AS A-S-78 *16567 


DEVELOPMENT OF LACIE 
WHEAT YIELD PREDICTION MODELS 


NASA-S-78-1 6568 

LACIE REQUIREMENT FOR A YIELD MODEL 

PREPARE ESTIMATES OF YIELD FOR AN AREA WHERE ACREAGE 
ESTIMATES ARE ALSO AVAILABLE IN ORDER TO ESTIMATE 
PRODUCTION WITHIN THAT AREA 

BASIC PREMISE 

CONSIDERABLE TECHNOLOGY FOR YIELD ESTIMATION EXISTED 
AND SHOULD BE TESTED FOR ITS ABILITY TO MAKE TIMELY, 
ACCURATE, OPERATIONAL ESTIMATES 

CONSTRAINTS IN LACIE 

• AVAILABLE DATA 

• TIME AVAILABLE FOR MODEL IMPLEMENTATION 

• NEED FOR BOTH EARLY-SEASON AND AT-HARVEST YIELD ESTI- 

MATES 
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NASA-S-78-1 6569 


POTENTIAL APPROACHES TO 
CROP YIELD MODELING 

• CAUSAL APPROACH 

• STATISTICAL REGRESSION 

APPROACH 

• ANALOG APPROACH 


NASA-S-78-1 6570 

SELECTION OF STATISTICAL 
REGRESSION APPROACH 

• ADVANTAGES 

• HISTORIC DATA BASES OF YIELD AND WEATHER READILY 

AVAILABLE FOR U S. AND MANY FOREIGN AREAS 

• LIKELY DEVELOPMENT AND IMPLEMENTATION WITHIN 

LAC IE TIME AND RESOURCE CONSTRAINTS 

• • EARLY RESEARCH REVEALED THAT REGRESSION MODELS 

HAD SKILL IN CORRELATING MONTHLY WEATHER WITH 
CROP YIELD 

• USED GLOBALLY AVAILABLE INPUT DATA TO PRODUCE 

BOTH EARLY-SEASON AND AT-HARVEST ESTIMATES 

• DISADVANTAGES 

• HIGH-QUALITY HISTORIC WEATHER AND YIELD DATA ARE 

NOT AVAILABLE FOR CERTAIN KEY FOREIGN AREAS 

• RESPONSE OF MODEL IS LIMITED BY HISTORIC EXTREMES 

AVAILABLE FOR MODEL DEVELOPMENT 
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N ASA-S-78-1 6571 


MODEL APPROACH 


BASED ON HISTORICAL TIME SERIES 
U.S DATA BEGIN IN 1932 

FOR OTHER FOREIGN AREAS, DATA BEGIN 1933-58 

USED MULTIPLE LINEAR REGRESSION AND A PRIORI KNOWLEDGE 
OF CROP RESPONSE TO SELECT PREDICTOR VARIABLES 

ASSUMPTIONS IN MODEL DEVELOPMENT 

• CROP IS IN SAME PHENOLOGICAL STAGE EACH MONTH EVERY 

YEAR AND IDENTICALLY SUSCEPTIBLE TO SAME WEATHER 
IMPACTS ON YIELD 

• HOMOGENEITY OF WEATHER DEPARTURES FROM NORMAL 

OVER ENTIRE REGION BEING MODELED 

• NO INTERACTIONS BETWEEN WEATHER AND TECHNOLOGY 

• SHORT-PERIOD WEATHER FLUCTUATIONS AND EPISODIC 

EVENTS ARE AVERAGED OUT OVER LARGE AREAS 


N ASA-S-78-1 6572 


MODEL FORM 


Y = CONSTANT + TREND + WEATHER EFFECTS 


CONSTANT 


TREND 


WEATHER EFFECTS = 


THE BASE YIELD CHARACTERISTIC OF A 
REGION IN THE ABSENCE OF TECHNO- 
LOGICAL ENHANCEMENT 

THE COMBINED EFFECT OF THE TECHNO- 
LOGICAL IMPROVEMENTS ON YIELD - 
EXPRESSED AS A FUNCTION OF THE 
CHRONOLOGICAL YEAR 

THE COMPONENT OF YIELD VARIATION 
ATTRIBUTABLE TO FLUCTUATIONS 
ABOUT THE LONG-TERM AVERAGE 
WEATHER IN A CROP REGION 


BASED ON PREMISE THAT THERE IS A LEVEL OF YIELD GENERAL- 
LY DETERMINED BY LOCAL TECHNOLOGY AND SOIL CAPABIL- 
ITY WITH YEAR-TO-YEAR FLUCTUATIONS ABOUT THAT LEVEL 
DUE TO WEATHER VARIATION 
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NASA-S-78-1 6573 


YIELD, 

BU/ACRE 


KANSAS WINTER WHEAT YIELD 


WEATHER 
EFFECT - 

FITTED TREND 


CONSTANT 


TECH-N 

NOLOGY 

EFFECT 


1885 1895 1905 1915 1925 1935 1945 1955 1965 1975 

YEAR 


NASA-S-78-1 6574 


AVERAGE STATE WHEAT YIELDS VS YEAR 
FOR NORTH DAKOTA SPRING WHEAT 

1879-1976 


YIELD, 

BU/ACRE 



- 


k J 
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N ASA-S-78-1 6575 


AVERAGE OKLAHOMA WHEAT YIELD AND 
EARLY-SEASON PRECIPITATION 


40 r 


1931-1976 


i 200 


YIELD, 
BU/ 

ACRE 20 



DEPAR- 
TURE 
50 FROM 

NORMAL 
PRECIP, 
mm 


1930 1 935 1 940 1945 1950 1955 1 960 1 965 1 970 1 975 

YEAR 


N ASA-S-78-1 6576 


AVERAGE WHEAT YIELD AND CROP SEASON RAINFALL 
FOR THE STATE OF UTTAR PRADESH, INDIA 

1959-1977 



YIELD, 

ql/ha 
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NASA-S-78-1 6577 


MODEL REGIONS 


• MODELS WERE DEVELOPED FOR REGIONS APPROXIMATELY 

STATE-SIZE THAT ARE RELATIVELY HOMOGENEOUS IN 
REGARD TO AGRICULTURAL PRACTICES AND POTENTIAL 

• REGIONS ARE COMPOSED OF SUBUNITS SUCH AS CROP 

REPORTING DISTRICTS FOR WHICH AVERAGE WEATHER 
AND YIELDS WERE AVAILABLE OVER A HISTORIC PERIOD. 
IN THE U S., THIS BEGINS ABOUT 1932 

• IN THE U.S.S R., THE MODELED REGIONS ARE SOMETIMES 

10 TIMES LARGER THAN THOSE IN THE U.S. 
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NASA-S-78-1 6579 


MODELING OF TECHNOLOGICAL TREND 

• OBSERVATIONS 

• SUSTAINED YIELDS ARE SIGNIFICANTLY HIGHER 

IN RECENT YEARS 

• MOST OF THE INCREASES CAME DURING THE 

PERIOD 1955-70 

• UPWARD TREND APPEARS TO HAVE LEVELED 

OFF IN RECENT YEARS 

• LIKELY CAUSES- 

• TECHNOLOGY MODELED AS PIECEWISE LINEAR 

TREND 

• POSSIBLE INTERACTIONS EXIST BETWEEN 

WEATHER AND TREND 


NASA-S-78-1 6580 


RATE OF FERTILIZER APPLICATION FOR WHEAT 


RATE/ACRE 

RECEIVING 

(POUNDS) 


NITROGEN 

PHOSPHOROUS 
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NASA-S-78-1 6581 


MODEL DEVELOPMENT 


• MODEL INPUTS ABE MONTHLY WEATHER VARIABLES FOR A 

REGION CALCULATED AS THE DEPARTURE FROM THEIR 
LONG-TERM AVERAGES 

• PRECIPITATION 

• TEMPERATURE 

• PR EC IP-POTENTIAL ET 

• PRECIP/PET 

• DEGREE DAYS ABOVE 90° F 

• MODEL FORM INCLUDES VARIABLES WHICH ARE SURROGATES 

FOR 

• TECHNOLOGY 

• MOISTURE STRESS 

DURING ASSUMED AVERAGE GROWTH STAGES 

• BOTH LINEAR AND QUADRATIC TERMS ARE OFFERED AS 

CANDIDATE VARIABLES 


NASA-S-78-1 6582 


VARIABLE SELECTION IN MODEL 

• AGRONOMIC SENSE WITH RESPECT TO 

THE KNOWN EFFECT OF THE VARIABLE 
ON YIELD AT THE ASSUMED PHENOLOG- 
ICAL STAGE 

• STATISTICAL SIGNIFICANCE 

• PERFORMANCE IN PREDICTING ON 

INDEPENDENT DATA 
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NASA-S-78-1 6583 



KANSAS WINTER WHEAT MODEL 

VARIABLES 

VARIABLE 

T STATISTIC 

SIGNIFICANCE 

OVERALL CONSTANT 

15.31069 

0.00000001 

LINEAR TREND 1943-1955 

4 04307 

0.00054265 

LINEAR TREND 1955-1972 

9.69801 

0.00000030 

AUG-NOV PRECIP (DFN) 

4.54036 

0.00020159 

MARCH PRECIP (DFN) 

4 44636 

0.00024162 

MAY PRECIP- PET (DFN) 

-1.43352 

0.15954435 

MAY PRECIP -PET (SDFN) 

-1 04317 

0.30609387 

MAY DAYS >90 DEG F 

-2 86651 

0.00737609 

JUNE PRECIP (DFN) 

-1.32841 

0.19205976 

R SQUARED 

0.92775 

ADJUSTED R SQUARE 

0.91023 

STANDARD ERROR 

1.46242 

STANDARD DEVIATION OF YIELDS 4.88097 


NASA-S-78-1 6584 

USDA WHEAT YIELD ESTIMATES VS CCEA MODEL 
ESTIMATES FOR SELECTED STATES 
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NASA-S-78-1 6585 


USDA WHEAT PRODUCTION ESTIMATES VS CCEA 
ESTIMATES (USING REPORTED USDA ACREAGE) 

'1965-1875 


CCEA, BUSHELS 



NASA-S-78-1 6586 


EARLY-SEASON ESTIMATION TECHNIQUE 

• SEVERAL APPROACHES TO ANTICIPATING MONTHLY 

WEATHER BETWEEN TIME OF PREDICTION AND 
HARVEST 

• USE EXTENDED WEATHER FORECASTS 

• ASSUME NORMAL WEATHER 

• DEVELOP ADDITIONAL MODELS BASED ONLY ON 

EARLY-SEASON WEATHER 

• AT-HARVEST MODELS WERE TRUNCATED BACKWARDS 

TO PRODUCE A SERIES OF NEW MODELS WHICH 
COULD BE USED EARLY IN THE SEASON 
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NASA-S-78-1 6587 

KANSAS STATE WINTER WHEAT MODEL 


TRUNCATION 


VARIABLE 

NOV 

MAR 

MAY 

JUN 

OVERALL CONSTANT 
LINEAR TREND 

7 93856 

8 14029 

9 64031 

9 40812 

1943-55 

LINEAR TREND 

.30267 

23759 

23530 

24259 

1955-72 

48160 

.55176 

.51971 

.52790 

AUG-NOV PREC (mm) 

02082 

.02068 

.01820 

01939 

MAR PREC (mm) 


05644 

05582 

.05664 

MAY PREC -PET (mm) 



-.01034 

-01211 

MAY PREC - PET (mm) 
MAY NUMBER DAYS 



- 00028 

-00017 

ABOVE 32° C 



- 29770 

- 30083 

JUN PREC (mm) 




-.00745 

R SQUARED 
STANDARD ERROR 

84268 

89058 

92388 

92775 

(Q/Ha) 

STANDARD VARIANCE 

2 01095 

1 69956 

1 47877 

1 46242 

(Q/Ha) 

4 04392 

2 88851 

2 18676 

2.13866 


NASA-S-78-1 6588 


MODEL EVALUATION 

• METHODOLOGY 

• HISTORIC WEATHER DATA USED TO 

PRODUCE INDEPENDENT TEST RESULTS 
SEQUENTIALLY ON MOST RECENT 10 YEARS 

• CRITERIA: 

• NO MORE THAN 2 OF THE 10 YEARS CAN BE 

OUTSIDE THE 10 PERCENT RELATIVE 
ERROR BOUND 
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N ASA-S-78-1 6589 


TEN-YEAR (1965-1974) YIELD MODEL EVALUATION 


RELATIVE 
ERROR 10 

A n 

P-P U 

p 5 -10 

PERCENT „„ 




NASA-S-78-1 6590 


PHASE I YIELD MODELS 

• PROJECTED YIELD TREND STEADILY UPWARD 

• ALLOWED FULL EFFECTS OF EXTREME 

PRECIPITATION AND TEMPERATURE 

• HAD REGIONS COMMON TO MORE THAN ONE 

MODEL IN SEVERAL AREAS 
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NASA-S-78-1 6591 


CHANGES AFTER PHASE I 

® UPWARD TREND LEVELED IN RECENT YEARS 

• INPUT DATA CENSORED ' 

TEMPERATURE - BOUNDED BY 5 AND 95 
PERCENTILE 

PRECIPITATION - BOUNDED BY 0 AND 90 
PERCENTILE 


NASA-S-78-1 


ELEVEN-YEAR (1965-1975) 


RELATIVE 2 , 
ERROR „ 


P -1i 
PERCENT _ 2 

-3 
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NASA-S-78-1 6593 


CHANGES AFTER PHASE 1 


• REALINED DATA BASES TO ELIMINATE 

OVERLAP AND LIKELY CORRELATIONS 

• CREATED NEW YIELD MODEL FOR 

MINNESOTA 


NASA-S-78-1 6594 

POTENTIAL AREAS OF IMPROVEMENT 
IN CROP YIELD MODELING 

• USE ADJUSTABLE CROP CALENDAR TO ELIMINATE ERRON- 

EOUS APPLICATION OF WEATHER WHEN CROP STAGE 
SIGNIFICANTLY DEPARTS FROM NORMAL 

• IMPROVE ESTIMATE OF PLANT AVAILABLE WATER THROUGH 

A SOIL WATER BUDGET 

• USE MINIMUM TEMPERATURE AS A VARIABLE TO CAPTURE 

LIKELY EFFECT OF COLD INJURY TO WINTER WHEAT 

• MODEL AGRONOMIC AND ECONOMIC INFLUENCES ON 

TECHNOLOGICAL TREND 

• IMPROVE TECHNIQUES FOR MAKING EARLY-SEASON YIELD 

ESTIMATES 
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NASA-S-78-1 6597 


COMPARISON OF THREE METHODS FOR EARLY-SEASON 
ESTIMATION OF WHEAT YIELDS (CONT) 



16.5 18.5 20.5 22.5 24.5 26.5 

YIELD 
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N79- 14463 


EXPERIMENT DESIGN-SESSION - - . 

CLASSIFICATION AND MENSURATION APPROACH 
R. Heydorn, JSC 


Original pttotography may be purchased from 

EROS EMa Center 

Sioux Fails, SD S'*) I 
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NAS A-S-78-1 6867 


CLASSIFICATION AND MENSURATION 
OF LACIE SEGMENTS 


NAS A-S-78-1 6868 

3-YEAR CLASSIFICATION AND MENSURATION 
EXPERIMENT DESIGN - OVERVIEW 

• THE FUNDAMENTAL APPROACH TO ESTIMATE THE 

ACREAGE OF WHEAT IN A 5-BY 6-N Ml AREA 

• MACHINE CLASSIFICATION METHODS TO IDENTIFY 

ALL WHEAT PIXELS IN THE SEGMENT 

• MANUAL INTERPRETATION METHODS TO PROVIDE 

SPECTRAL EXAMPLES OF WHEAT AND NONWHEAT 
WITH WHICH TO "TRAIN" THE CLASSIFIER AND 
TO ADJUST FOR CLASSIFICATION-ERROR-RELATED 
BIAS 

• USES NO GROUND ENUMERATIVE DATA EXCEPT AFTER- 

THE-FACT TO EVALUATE RESULTS 
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NASA-S-78-1G869 


3-YEAR CLASSIFICATION AND MENSURATION 
EXPERIMENT DESIGN - OVERVIEW (CONT) 

• TWO DESIGNS WERE TESTED. THE SECOND DESIGN WAS 

MOTIVATED BY CLASSIFICATION AND MANUAL INTER- 
PRETATION PROBLEMS ENCOUNTERED IN THE FIRST 2 
YEARS 

• IN THE FIRST DESIGN, AN ANALYST TRAINS THE CLASS- 

IFIER TO MENSURATE A SEGMENT 

• ANALYST DOES NOT PERFORM AN INVENTORY FUNCTION 

• IN THE SECOND DESIGN (P-1), BOTH THE ANALYST AND THE 

MACHINE PERFORM AN INVENTORY FUNCTION 

• ANALYST TRAINS THE CLASSIFIER 

• CLASSIFICATION TREATED AS A SMALL-GRAINS/NON- 

SMALL-GRAINS STRATIFICATION 

• ANALYST PERFORMS A STRATIFIED AREAL ESTIMATE 

• CONSISTENCY CHECKS ARE MADE BETWEEN ANALYST 

LABELING RESULTS AND MACHINE CLASSIFICATION 
RESULTS 


NASA-S-78-1 6870 

PROCESSING FLOW IN CAMS 


LABELING 


CLASSIFICATION 





CLASSIFICATION MODEL 


NASA S-78- 16871 


• EACH PIXEL OF SPECTRAL MEASUREMENTS, x, IS CLASSIFIED 

AS BELONGING TO A SMALL-GRAINS OR TO A NON-SMALL- 
GRAINS CLASS USING AN APPROXIMATION TO A BAYES 
APPROACH 

• LET f., (•) = LIKELIHOOD THAT A PIXEL IS SMALL GRAINS 

f 0 (•) = LIKELIHOOD THAT A PIXEL IS NON-SMALL-GRAINS 
7 r= PRIOR PROBABILITY THAT A PIXEL IS SMALL GRAINS 

BASIC MODEL: 

"DECIDE PIXEL x BELONGS TO THE CLASS OF ALL SMALL 
GRAINS IF 

7rf-| (x) > (1 * 77") f 0 (x) 

AND x BELONGS TO THE CLASS OF ALL NON-SMALL GRAINS 
OTHERWISE" 

• EACH LIKELIHOOD IS APPROXIMATED BY A SUM OF NORMAL 

DISTRIBUTIONS 


N ASA-S-78-1 6872 

MANUAL FIELD SELECTION AND LABELING 

• THROUGH THE USE OF MANUAL INTERPRETATION METHODS, 

FIELDS OF SMALL GRAINS AND NON-SMALL-GRAINS ARE 
SELECTED AND LABELED. THESE FIELDS ARE USED TO 
TRAIN THE CLASSIFIER 

• FIELDS ARE ENCLOSED IN POLYGONS AND THE VERTICES 

OF THOSE POLYGONS USED AS THE FIELD LOCATION 
INDEXES IN THE MACHINE PROCESSING 

• AREAS THAT ARE DEFINITELY NON-SMALL-GRAINS AND 

LIKELY TO BE MISCLASSIFIED ARE ALSO ENCLOSED IN 
POLYGONS AND LABELED "DESIGNATED OTHER" (DO) 

• AREAS COVERED BY CLOUDS ARE ALSO ENCLOSED IN 

POLYGONS AND LABELED "DESIGNATED UNIDENTIFIABLE" 
(DU). THESE AREAS ARE DISCARDED FROM THE SEGMENT 
ESTIMATE 
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NASA-S 78-16873 


ESTIMATE EVALUATION 

• ANALYST COMPARES THE CLASSIFICATION MAP WITH THE 

MSS IMAGE 

• ERROR IN CLASSIFICATION CAN BE A RESULT OF 

- MISLABELING 

- NOT SELECTING A "REPRESENTATIVE" SAMPLE 

FROM EACH SUBCLASS 

- AREA CANNOT BE RESOLVED BY THE BAYES RULE 

IN AN ERROR-FREE WAY 

• CORRECTIONS TO THE LABELING OR FIELD SELECTION 

PROCESS ARE MADE AND THE SEGMENT IS RECLASS- 
IFIED 


NASA-S- 78 -164 93 

CLASS MAP - CIR IMAGE COMPARISON 



CIR IMAGE CLASS MAP 


CHOUTEAU, MONTANA 
JULY 3, 1977 
(BIOWINDOW 4) 
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N ASA-S-78-1 6874 

PROBLEMS WITH THE PHASE I AND I DESIGN 

SELECTING AND LABELING FIELDS 

• BASICALLY, THE ANALYST WAS REQUIRED TO INTERPRET 

COLOR IMAGERY TO ANSWER QUESTIONS SUCH AS 

• "HOW MANY NORMAL DISTRIBUTIONS WILL FIT THE 

DATA?" 

• "HOW MANY FIELDS SHOULD BE SAMPLED?" 

• ANALYST MUST SAMPLE AND LABEL FIELDS AS BELONG- 

ING TO ONE CLASS WHEN, IN FACT, BASED ON SPECTRAL 
MEASUREMENTS ALONE, THE FIELDS ARE "MORE 
LIKELY" TO BELONG TO ANOTHER CLASS 

• IN STATISTICAL TERMS, THE ANALYST MUST SAMPLE 

AND LABEL OBSERVATION FROM THE "TAILS OF 
DISTRIBUTIONS" 

• THERE IS A TENDENCY TO SAMPLE ONLY FROM THE 

HIGH-DENSITY OR MORE LIKELY PORTION OF A 
CROP SPECTRAL DISTRIBUTION 


N ASA-S-78-1 6875 


DIAGRAMMATIC EXPLANATION OF “SAMPLE FROM 
ONLY THE CENTRAL PART OF THE DISTRIBUTION” 


SUBCLASS DISTRIBUTION SUBCLASS DISTRIBUTION 

OF SMALL GRAINS OF NON-SMALL-GRAINS 



MOST LIKELY RANGES BEING SAMPLED 
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N ASA-S-78-1 6876 

PROBLEMS WITH THE PHASE I 
AND JL DESIGN (CONT) 


EFFICIENCY 

• THE DESIGN WAS NOT EFFICIENT FOR A LARGE-SCALE 
BATCH-PROCESSING OPERATION 

• THE ONLY WAY A SEGMENT ESTIMATE COULD BE 

MODIFIED WAS TO RECLASSIFY IT. SINCE MANY 
SEGMENTS REQUIRED REWORK, PROCESSING 
DELAYS WERE EXPERIENCED 

• ACCURATELY DETERMINING POLOYGONAL FIELD 

VERTICES AND PUNCHING THEM ONTO CARDS 
WAS SLOW 

• BY THE END OF PHASE II, THE AVERAGE TIME 

REQUIRED TO PROCESS A SEGMENT WAS 7 HOURS 


N ASA-S-78-1 6877 

PROBLEMS WITH THE PHASE I 
AND H DESIGN (CONT) 

SMALL-FIELD PROCESSING 

• IN COMPARISON TO LARGE-FIELD AREAS, 

SMALL-FIELD AREAS REQUIRE THAT MANY 
MORE SAMPLE FIELDS BE SELECTED 

• MORE FIELDS AND MORE FIELD BOUNDARIES 
INCREASE THE SPECTRAL VARIANCE IN THE 
SCENE 

• MORE DIFFICULT TO IDENTIFY A GOOD SET OF 

SUBCLASSES TO FIT THE DATA 
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N ASA-S-78-1 6878 

PROBLEMS WITH THE PHASE I 
AND H DESIGN (CONT) 

MULTITEMPORAL PROCESSING 

• BELIEF IS THAT TO DISCRIMINATE WELL BETWEEN 

CROP TYPES, MSS MEASUREMENTS AT SEVERAL 
STAGES OF CROP GROWTH MUST BE SIMULTANE- 
OUSLY CONSIDERED - THAT IS - MULTITEMPORALLY 
PROCESSED 

• ATTEMPTS TO OBTAIN MULTITEMPORAL CLASSIFICATION 

WERE LARGELY UNSUCCESSFUL 

• ANALYST MUST NOW ACCOUNT FOR MORE SUBCLASSES 

DUE TO THE MORE COMPLEX DIMENSIONAL DATA 

• COVARIANCES IN THE DATA INCREASE THE REQUIRE- 

MENT FOR A LARGER SAMPLE OF FIELDS 


N ASA-S-78-16879 

PROCESSING FLOW IN PROCEDURE 1 
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N ASA-S-78-1 6880 

LABELING REQUIREMENTS 

• THE PURPOSE OF LABELING IS TO 

• OBTAIN TRAINING SAMPLES 

• OBTAIN A STRATIFIED AREAL ESTIMATE (SAE) 

• EVALUATE THE CLASSIFIER 

• OF THE 22 932 PIXELS IN THE LACIE SEGMENT, 209 ARE 

SELECTED AS CANDIDATE LABELING "DOTS” 

• THE 209 DOTS ARE THOSE PIXELS COINCIDING WITH A 

GRID SPACING OF EVERY 10TH ROW AND EVERY 10TH 
COLUMN OF A LACIE SEGMENT 

• TWO SETS OF DOTS ARE LABELED - TYPE 1 AND TYPE 2 

• TYPE 1 DOTS ARE USED FOR TRAINING. APPROXIMATELY 

40 ARE SELECTED AT RANDOM FROM THE 209 

• TYPE 2 DOTS ARE USED FOR THE SAE AND FOR EVALUA- 

TION. APPROXIMATELY 60 ARE SELECTED AT RANDOM 
FROM THE 209 
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NASA-S-78-16881 


PRODUCTS USED IN LABELING 

• DOTS ARE LABELED BY 
THE ANALYST USING 

• CIR IMAGERY 

• TRAJECTORY PLOTS 

• SCATTER PLOTS 

• ANCILLARY DATA 

- CROP CALENDARS 

- WEATHER SUMMARIES 

- CROPPING PRACTICES 

- OTHER 


NASA-S-78-16882 

PRODUCTS USED IN LABELING (CONT) 

• FOR DISPLAY PURPOSES, FOUR DIMENSIONAL LANDSAT 

DATA ARE PROJECTED ONTO TWO COORDINATES CALLED 
"BRIGHTNESS" AND "GREENNESS" 

• BRIGHTNESS COORDINATE MEASURES SCENE BRIGHTNESS 

• GREENNESS COORDINATE MEASURES CROP GROWTH 

DEVELOPMENT 

• TRAJECTORY PLOTS DISPLAY THE MOVEMENT OF 

BRIGHTNESS-GREENNESS COORDINATES ACROSS FOUR 
TIMES RELATED TO THE PHENOLOGICAL STAGES - 
PLANTING TO EMERGENCE, EMERGENCE TO JOINTING, 
JOINTING TO HEADING, HEADING TO RIPE 

• SCATTER PLOTS DISPLAY THE BRIGHTNESS-GREENNESS 

COORDINATES OF EVERY DOT WITH A GIVEN ACQUISITION 
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NASA S 78 12511 


SPECTRAL SCATTERGRAMS, 

FINNEY CO., KANSAS 



N ASA-S-78-1 6883 


ANALYST AID - TRAJECTORY PLOT 


GREENNESS 
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BRIGHTNESS 
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NASA-S-78- 16884 


ANALYST AID - SCATTER PLOT 



N ASA-S-78-1 6885 

LABELING APPROACH 


• FUNDAMENTAL CONCEPTS USED IN DOT LABELING 

• THE SEQUENCE OF FILM COLORS, OR THE NUMERICAL 
LANDSAT VALUES, (PHOTOPHENOLOGY) OVER TIME 
IS RELATED TO TRANSITIONS OF CROP GROWTH 
STAGES (PHENOLOGY) 


PHENOLOGY 

PHOTOPHENOLOGY* 

• tivitmjtiMUt _a. 


• MEDIUM GREEN 

• TILLERING y 

LANDSAT 

y • LIGHT PINK/GREEN 

• BOOTING W 


** • ORANGE 

• HEADING 

• ORANGE 

• RIPE 

• RED 

• POSTHARVEST 

• GREEN 


* COLORS DEPEND ON ENVIRONMENTAL (SOILS), 

ATMOSPHERIC, AND FILM-GENERATION FACTORS 
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LABELING APPROACH (CONT) 

• FUNDAMENTAL CONCEPTS USED IN DOT LABELING 
(CONT). 

• CROP TYPES HAVE UNIQUE CROP CALENDARS 

• CROPS GROW IN FIELDS THAT CAN HAVE UNIQUE 

SIZES AND SHAPES DEPENDING ON THE CROP TYPE 

• ABNORMAL WEATHER EVENTS THROUGHOUT THE 

GROWING SEASON WILL CAUSE DEPARTURE FROM 
NORMAL GROWTH 

• HISTORICAL DATA ON CROP PERCENTAGES CAN BE 

USED TO ESTIMATE A PROBABILITY THAT A CROP 
IS PRESENT 


N ASA-S-78-1 6887 

LABELING APPROACH (CONT) 

• GENERAL STEPS IN DOT LABELING 

• HISTORICAL INFORMATION SUCH AS PERCENTAGE OF 

A GIVEN CROP GROWN IN THE AREA, CROPPING 
PRACTICES, ETC, IS REVIEWED 

• WHEAT CROP CALENDAR MODEL PREDICTIONS AND 

WEATHER SUMMARIES ARE CONSULTED TO ADJUST 
NOMINAL CROP CALENDARS FOR WHEAT AND CON- 
FUSION CROPS 

• DETERMINATION IS MADE WHETHER OR NOT A DOT IS 

IN A FIELD 

• TEMPORAL COLOR SEQUENCE AND THE TRAJECTORY 

PLOT OF A DOT IS CORRELATED WITH ADJUSTED 
CROP CALENDARS TO MAKE A SMALL-GRAINS OR 
NON-SMALL-GRAINS DETERMINATION 

• SCATTER PLOTS AND CLASSIFICATION PRODUCTS ARE 

CONSULTED TO EVALUATE LABELING DECISIONS 
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LABELING APPROACH (CONT) 

• IN ANY GIVEN APPLICATION, THE SPECIFIC DECISION- 

MAKING STRATEGY IS HIGHLY PROBLEM DEPENDENT 

• IN GENERAL, DOTS ARE LABELED ACCORDING TO THE 

FIELD THAT CONTAINS THE DOT 

• TYPE 1 DOTS IN UNREPRESENTATIVE PORTIONS OF 

A FIELD OF ONE CROP TYPE MAY BE ASSIGNED A 
LABEL DIFFERENT FROM THE FIELD LABEL 

• TYPE 1 BOUNDARY DOTS ARE NOT LABELED 

• ALL TYPE 2 DOTS ARE LABELED 


NASA-S-78-16889 

CLUSTERING 


• LABELED TYPE 1 DOTS ARE USED TO START CLUSTERING 

AND TO LABEL THE RESULTING CLUSTERS AS BEING 
SMALL-GRAINS OR NON-SMALL-GRAINS CLUSTERS 

• ALL THE PIXELS IN A GIVEN CLUSTER ARE TREATED AS 

OBSERVATIONS FROM ONE SUBCLASS AND ARE USED 
TO ESTIMATE THE MEAN AND COVARIANCE MATRIX 
OF THAT SUBCLASS 

• CLUSTER AND CONDITIONAL CLUSTER MAPS ARE PROVIDED 

TO EVALUATE THE RESULTS 

• CLUSTER MAP IS A SPATIAL MAP (SIMILAR TO THE CIR 

IMAGE) WITH ALL AREAS IN A GIVEN CLUSTER ASSIGNED 
ONE COLOR; ALL CLUSTERS HAVE SEPARATE COLORS 

• CONDITIONAL CLUSTER MAP IS THE SAME AS A CLASS MAP 

EXCEPT THAT AREAS WITHIN THRESHOLD DISTANCE 
FROM ANY LABELING DOT ARE ASSIGNED A SEPARATE 
COLOR 
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EVALUATION AIDS, CHOUTEAU, MONTANA 


\ A. * V''/| 1 • P * v 


MULTITEMPORAL 
CLUSTER MAP 


MULTITEMPORAL 
CONDITIONAL CLUSTER MAP 
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o£ POOR quality 


STRATIFIED AREAL ESTIMATION 

THE SMALL-GRAINS AREAL ESTIMATE IS OBTAINED 
BV COMBINING THE RESULTS OF TYPE 2 DOT 
LABELING WITH THE MACHINE CLASSIFICATION 
RESULT USING THE FOLLOWING FORMULA: 


P=a 1~N + "2 m 


N 
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EVALUATION 

• EACH SEGMENT ESTIMATE IS EVALUATED BY CHECKING FOR 

INCONSISTENCY BETWEEN ANALYST LABELS AND MACHINE 
CLASSIFICATION 

• QUANTITATIVE AND QUALITATIVE CHECKS USED 

• QUANTITATIVE CHECKS 

• PROBABILITY OF MISCLASSIFICATION AS DETERMINED 

FROM TYPE 2 LABELED DOTS 

• COMPARISON OF SAE WITH THE MACHINE ESTIMATE 

- MACHINE ESTIMATE COMPARED WITH CONFIDENCE 

INTERVAL ABOUT THE SAE 

• QUALITATIVE CHECKS 

• COMPARISONS ARE MADE AMONG 

- CIR IMAGERY 

- CLASS MAP 

- CONDITIONAL CLUSTER MAP 


N ASA-S-78-1 6894 

TEST AND EVALUATION OF PROCEDURE 1 

TESTS PERFORMED 

• EVALUATIONS WERE DONE USING GROUND TRUTH FOR 

LABELING DOTS TO 

• ESTIMATE PARAMETER VALUES 

• EVALUATE CLUSTERING AND CLASSIFICATION 

PERFORMANCE 

• DETERMINE BIAS AND EFFICIENCY OF THE SAE 

• ANALYST INTERPRETATION THEN USED FOR ALL DOT 

LABELING TO STUDY THE EFFECTS OF LABELING 
ERROR ON PERFORMANCE 

• COMPARISON OF P-1 CLASSIFICATION PERFORMANCE 

WITH CLASSIFICATION PERFORMANCE OF THE PHASE 
I & n DESIGN WAS ALSO DONE 
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TEST AND EVALUATION OF PROCEDURE 1 

(CONT) 

SUMMARY OF RESULTS 

• AVERAGE CLASSIFICATION ERROR (G T. LABELING) 

• ON LARGE-FIELD SEGMENTS -85 PERCENT 

• ON SMALL-FIELD SEGMENTS -70 PERCENT 

• AVERAGED ACROSS FIELDS -80 PERCENT 

• NO DETECTABLE DIFFERENCE BETWEEN USING Al OR GT 

LABELED DOTS 

o NO DETECTABLE DIFFERENCE BETWEEN Al AND GT SAE'S 
NOR WAS ANY BIAS DETECTED IN THOSE ESTIMATES 
(STUDY BASED ON 25 SEGMENTS) 

VARIANCE OF SAE 

VARIANCE OF SIMPLE RANDOM-SAMPLE 
ESTIMATE 

IS LOW (-0.25) WHEN AVERAGED ACROSS ALL SEGMENTS 

• IMPROVEMENT IN MULTITEMPORAL CLASSIFICATION PERFORM- 

ANCE OF P-1 WHEN COMPARED WITH THE PHASE I & H DESIGN 


© EFFICIENCY /l 
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CONCLUSIONS 


• MULTITEMPORAL MACHINE CLASSIFICATION 

IS ROUTINELY DONE WITH P-1, WHEREAS IN 
THE FIRST DESIGN MOST ATTEMPTS FAILED 

• P-1 PROVIDED AN OVERALL ACCURACY 

IMPROVEMENT OVER THE FIRST DESIGN 

• ANALYST SEGMENT CONTACT TIME CUT IN 

HALF 
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CONCLUSIONS (CONT) 


• THE SAE WILL BE MORE EFFICIENT (SMALLER VARIANCE) 
THAN AN ESTIMATE THAT CAN BE OBTAINED DIRECTLY 
(NO MACHINE CLASSIFICATION) FROM TYPE 2 DOT 
LABELING, BUT 

• MAY NOT ALWAYS BE MORE EFFICIENT THAN THE 

ESTIMATE THAT COULD BE OBTAINED FROM THE 
COMBINED TYPE 1 AND TYPE 2 DOT SAMPLES 
(ASSUMING THAT THE ANALYST WOULD LABEL 
TYPE 1 BOUNDARY DOTS) 

- EFFICIENCY DEPENDS ON OMISSION AND COMMISSION 
ERROR RATES IN THE CLASSIFIER 
• THIS MAY DEPEND ON FACTORS SUCH AS FIELD 

SIZE, AMOUNT OF SMALL GRAINS IN THE SEGMENT, 
ETC 

• MORE EFFICIENCY CAN PROBABLY BE OBTAINED BY 

TRAINING ONLY A SUBSET OF SEGMENTS TO BE CLASS- 
IFIED , i.e., A SIGNATURE EXTENSION APPROACH 
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EXPERIMENT DESIGN SESSION 


ACCURACY ASSESSMENT - THE STATISTICAL 
APPROACH TO PERFORMANCE EVALUATION 
G. Houston, JSC 
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ACCURACY ASSESSMENT 
THE STATISTICAL APPROACH TO 
PERFORMANCE EVALUATION 
IN LACIE 


NASA-S-78-16899 


OUTLINE 

• ACCURACY ASSESSMENT OBJECTIVES 

• 90/90 CRITERION AND EVALUATION 

• PRODUCTION ERROR COMPONENTS 

AND ANALYSES 


ME E > INTENTIONALLY BLANK; 
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ACCURACY ASSESSMENT 


• NEED 

• TIMELY IDENTIFICATION OF MAJOR PROBLEM AREAS 

AND RECOMMENDATIONS FOR IMPROVEMENTS 

• OBJECTIVES 

o TO DETERMINE THE ACCURACY AND RELIABILITY 
OF LAC IE ESTIMATES OF PRODUCTION, AREA, AND 
YIELD MADE AT REGULAR INTERVALS THROUGHOUT 
A CROP SEASON 

• TO DETERMINE WHETHER OR NOT THESE ESTIMATES 

SUPPORT THE 90/90 ACCURACY GOAL 

• TO INVESTIGATE THE VARIOUS ERROR SOURCES OF 

THESE ESTIMATES, QUANTIFY AND RELATE THESE 
ERROR SOURCES TO CAUSAL ELEMENTS IN LAC IE 
ESTIMATION PROCESS 


IMASA-S-78-1 6901 


• 90/90 CRITERION 

• LET P = LACIE ESTIMATE OF WHEAT PRODUCTION 



- SHADED AREA MUST BE GREATER THAN OR EQUAL 

TO 0.9 

- WHETHER OR NOT IT IS SATISFIED IS A FUNCTION 

OF WHAT B AND crp 2 ARE 
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VALUES OF RELATIVE BIAS (RB) AND COEFFICIENT 
OF VARIATION (CV) THAT SUPPORT 90/90 



NASA-S-78-16903 

EXAMPLE 

• PHASE HITOTAL WHEAT PRODUCTION FOR USGP 

• OBSERVED CV = 4.8'PERCENT 

® TOLERABLE RANGE FOR RELATIVE BIAS (-4.2 PERCENT, 
+3.4 PERCENT) 

• OBSERVED RELATIVE DIFFERENCE AS COMPARED TO ESCS 

RD - -10.0 PERCENT 

- MOST LIKELY 90/90 ESTIMATOR HAS 

CV= 4.8 PERCENT 
RB= -4.2 PERCENT 

• QUESTION: WHAT IS PROBABILITY OF 90/90 ESTIMATOR 

HAVING A RELATIVE DIFFERENCE LESS THAN OR 
EQUAL TO -10.0 PERCENT? 
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FOLLOWING IS A HISTOGRAM OF 50 RELATIVE 
DIFFERENCES FROM SUCH A 90/90 ESTIMATOR 



RD, PERCENT 


P- IP 


5 OBSERVATIONS {10 PERCENT) WERE LESS THAN 
-10 0 PERCENT 

• THEORETICALLY, ANSWER IS 13.7 PERCENT 

• CONCLUSION INSUFFICIENT EVIDENCE TO 

REJECT 90/90 
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FIRST-ORDER ERROR COMPONENTS 


PRODUCTION ERROR 
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COMPARISONS WITH REFERENCE STANDARD 

• COMPARE LAC IE ESTIMATES (P, A, Y) WITH REFERENCE STANDARD 
AT COUNTRY AND REGION LEVELS 

• ASSUME LACIES N (fi, a 2 ), /x UNKNOWN 

-TESTH 0 : fj. = STANDARD 

VS 

H a : /x ^ STANDARD 

-TEST STATISTIC 

LACIE- STANDARD . , , 

Z = 7 N{0,1) 


o REPORT RESULTS BY 

- RELATIVE DIFFERENCE = 


LACIE -STANDARD 
LACIE 


x 100 PERCENT 


-COEFFICIENT OF VARIATION = x 100 PERCENT 

LACIE 
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AREA ERROR SOURCES 


• BIAS ESTIMATION (WEIGHTED ANALYSIS) 

• LACIE ACREAGE ESTIMATE FOR A LARGE AREA MAY BE 

EXPRESSEDAS 

N 

A = 2 W,P| 

A 1 = 1 

WHERE P| = SEGMENT WHEAT PROPORTION ESTIMATE 
W| = WEIGHT WHICH DEPENDS ON SIZE OF 

CORRESPONDINGSTRATUM.NO SEGMENTS 
IN STRATUM, GROUP HI RATIO, ETC 
N = NUMBER OF ACQUIRED SEGMENTS 

• TRUE ACREAGE ESTIMATE FOR LARGE AREA MAY BE 

EXPRESSEDAS 

N 

a = 2 wjc, 

i = i 

WHERE C| = TRUE STRATUM WHEAT PROPORTION 

Wt = IDEAL WEIGHTS FOR THE N ACQUIRED SEGMENTS 
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AREA ERROR SOURCES (CONT) 

• BIAS ESTIMATION (CONT) 

A N A N 

• a- a= 2 W| p r s wjc, 

1=1 1=1 

N A N N 

= S w, (p,-p,)+ 2 w, (p r c,)+s c, (Wj-w|) 

1=1 1=1 1=1 

= b c + B s + B m 

WHERE B c = ERROR DUE TO CLASSIFICATION 
B s = ERROR DUE TO SAMPLING 
Bjjj = ERROR DUE TO GROUPIE RATIO 

• (P| -P|) =0|, 0, UNKNOWN 

ASSUME B s NEGLIGIBLE, SINCE SEGMENTS ARE RANDOMLY 
LOCATED IN STRATA 
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AREA ERROR SOURCES (CONT) 

• BIAS ESTIMATION (CONT) 

N 

• ESTIMATION OF B ffl = £ C|(W,-W*) 

1 = 1 

- FOR A PREVIOUS YEAR FOR WHICH STRATUM-LEVEL 
SRS ESTIMATES ARE AVAILABLE, REPLACE C| BY 
CORRESPONDING SRS STRATUM WHEAT PROPORTION 
ESTIMATE 

^ £ 

— THEN Bjjj = 2 W,C,-A SRS 
1 = 1 

WHERE A srs = SRS WHEAT ESTIMATE FOR THE LARGE 
AREA 


N ASA-S-78-1 6911 

AREA ERROR SOURCES (CONT) 

• BIAS ESTIMATION (UNWEIGHTED ANALYSIS) 

• LET N BE THE NUMBER OF SEGMENTS ACQUIRED IN A REGION 

(STATE OR HIGHER) AND LET n BE THE NUMBER OF BLIND 
SITES IN THE REGION 

• FOR 1 = 1, ,N LET 

X,= WHEAT PROPORTION ESTIMATE FOR I th SEGMENT 
AND 

X, = GROUND-TRUTH WHEAT PROPORTION FOR I th SEGMENT 

• THE AVERAGE ERROR B IS GIVEN BY 

1 5 A 

B = -S (X,-X|) 

1 = 1 

• ESTIMATE B BY 

U=isD r -is 

n I = 1 n 1 = 1 
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AREA ERROR SOURCES (CONT) 

• IF B SIGNIFICANTLY DIFFERENT FROM ZERO, DETERMINE 
CONTRIBUTIONS OF SMALL-GRAINS CLASSIFICATION 
ERROR AND WFIEAT-TO-SM ALL-GRAINS RATIO ERROR IF 
APPROPRIATE 

• X, = R|G| WHERE Rj = ESTIMATE OF RATIO 

G, = SMALL-GRAINS ESTIMATE 

• AVERAGE ERROR B AND MEAN SQUARED ERROR MSE 

OF WHEAT PROPORTION ARE ESTIMATED BY 

A I J1 A A 

B=— E (RiGi -RiGi) 

" I = 1 

A 1 JL A A 9 

MSE = S (R| g | * R|Gf) 


NASA-S-78-1 6913 

AREA ERROR SOURCES (CONT) 

• CONTRIBUTION OF A PARTICULAR ERROR IS MEASURED BY 

THE REDUCTION IN THE AVERAGE ERROR OR THE MEAN 
SQUARED ERROR THAT IS ACHIEVED WHEN THAT ERROR 
FACTOR IS ELIMINATED 

• AVERAGE ERROR AND MEAN SQUARED ERROR ESTIMATES 

WITH NO RATIO ERROR 

(rA-R|G,) 

1 = 1 

A i J1 A o 

MSE-,^2 (R[G, - R t G|) 2 

I = 1 

• ACREAGE ERROR AND MEAN SQUARED ERROR ESTIMATES 

WITH NO CLASSIFICATION ERROR 

A 1 JL A 

b 2 =7" 2 (R|G| -R,G,> 

1=1 

A 1 J2 A 9 

2 (R|G r R|G,) z 
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AREA ERROR SOURCES (CONT) 

• CONTRIBUTIONS OF SAMPLING AND CLASSIFICATION 
ERRORS TO VARIANCE OF ACREAGE ESTIMATE 
• VARIANCE OF ACREAGE ESTIMATE FOR LARGE 
AREA MAY BE EXPRESSED AS: 

VAR (A) = 2 V|<F, 2 
I 

WHERE o', 2 = VARIANCE OF ACREAGE ESTIMATE FOR 
I th STRATUM 

V ( = WEIGHT WHICH DEPENDS ON SIZE, 
NUMBER OF SEGMENTS, ETC 
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AREA ERROR SOURCES (CONC) 

• ASSUME <T| 2 = o- c 2 + X 2 a- s 2 

WHERE ctq 2 = CONTRIBUTION DUE TO CLASSIFICATION 
X 2 <r s 2 = CONTRIBUTION DUE TO SAMPLING 

• PROPORTION OF LARGE-AREA ACREAGE ESTIMATE VARI- 

ABILITY DUE TO 

X 2 <r s 2 

SAMPLING R = 

<r c 2 + X 2 o- s 2 

CLASSIFICATION 1-R 

• MAXIMUM LIKELIHOOD APPROACH AND REGRESSION 

TECHNIQUES USED TO ESTIMATE <r s 2 , Oq 2 , AND X 
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YIELD ERROR SOURCES 

I 

• YIELD PREDICTIONS ARE PROVIDED BY THE CCEA 
OF NOAA 

• PREDICTIONS ARE PRODUCED AT THE ZONE LEVEL 

FROM MULTIPLE LINEAR REGRESSION MODELS 
DEVELOPED FROM HISTORICAL YIELD AND 
WEATHER DATA 

• ESTIMATES OF THE YIELD PREDICTION ERROR AT 

THE ZONE LEVEL ARE ALSO PROVIDED BY CCEA 
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• TEN-YEAR TESTS 

• BOOTSTRAP PROCEDURE USED TO GET 10 YEARS OF 

YIELD PREDICTIONS AND CORRESPONDING PREDICTION 
ERROR ESTIMATES 

- DETERMINE IF BIASES ARE INDICATED 

- EVALUATE ESTIMATED PREDICTION ERRORS BY 

COMPARISON WITH OBSERVED MEAN SQUARED 
ERROR OVER THE TEST SET 

- 90/90 EVALUATION MADE INDEPENDENT OF ACREAGE 

ESTIMATION ERRORS (SRS AREA ESTIMATES ARE 
USED TO FORM A PRODUCTION ESTIMATOR WITH 
NO ACREAGE ESTIMATION ERROR) 
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SECOND-ORDER ERROR 
SOURCE INVESTIGATIONS 

• METHODOLOGY USED IS GENERALLY 
RESTRICTED TO- 

• PLOTTING AND TABULATION OF DATA 

• FITTING DATA BY REGRESSION TO 

EXAMINE RELATIONSHIPS 

• TESTS OF SIGNIFICANCE FOR COMPAR- 

ATIVE ANALYSES 


NASA-S-78-16919 
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SYSTEM IMPLEMENTATION AND OPERATIONS SESSION - . 


THE LAC IE APPLICATION EVALUATION SYSTEM (AES) - 
A DESIGN OVERVIEW 
R. Hill, JSC 
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THE LACIE APPLICATIONS 
EVALUATION SYSTEM (AES) 

A DESIGN OVERVIEW 


NASA-S-78-16501 


LACIE PROJECT ELEMENTS 


• GENERAL 

RESEARCH AND 

TECHNOLOGY 

DEVELOPMENT 

• LANDSAT-1 

INVESTIGATION 

• ASSESSMENT 

OF AVAILABLE 
CROP 

IDENTIFICATION 

TECHNOLOGY 


SPECIFIC 
PROCEDURES! 

> 


APPLICATION 

EVALUATION 

SYSTEM 


CANDIDATE 

PRO- 

CEDURES 




"LACIE" 


3 


TEST AND 
EVALUATION 

~T 


GENERAL 

TECHNIQUES r 
— LACIE R&D 




USER EVAL- 
UATION OF 
APPLICA- 
TION 
SYSTEM 


4 } 


SPECIFICA- 
TIONS FOR 
USER- [^>j 
ORIENTED 
SYSTEMS 


s\ 


3 


PROTOTYPE 

FOR 

EVENTUAL 

OPERA- 

TIONAL 

SYSTEMS 


85 


PMEJJf INTENTIOWALLY BLA*. 




NASA-S-78-16502 


OUTLINE OF PRESENTATION 


• OBJECTIVES 

• TECHNICAL APPROACH 

• IMPLEMENTATION AND DATA FLOW 

® ORGANIZATION, INTEGRATION, AND 
CONTROL 

• CHRONOLOGY 

• DATA LOAD AND OPERATIONS 

• MAJOR ACCOMPLISHMENTS 


N ASA-S-78-1 6503 

LACIE APPLICATIONS EVALUATION SYSTEM 

OBJECTIVES 

« PROVIDE FROM AN ANALYSIS OF LANDSAT AND 
METEOROLOGICAL DATA, EXPERIMENTAL 
ESTIMATES OF WHEAT PRODUCTION, AREA, 

AND YIELD 

• 90/90 AT HARVEST (PRODUCTION AT COUNTRY 

LEVEL) 

• EVALUATE ACCURACY ATTAINED EARLIER IN 

THE SEASON 
a OBJECTIVE 
a TIMELY 

a CONFIDENCE ESTIMATES 

• DEVELOP OPERATIONAL AND DATA FLOW CONCEPTS 

AND PROCEDURES 

• IDENTIFY KEY TECHNICAL ISSUES 
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TECHNICAL IMPLEMENTATION 


LANDSAT 





AREA 

mcaoi in r-Rnr mt 


SAMPLING 

AND 

AGGREGATION 

STRATEGY 



PRODUCTION 



YIELD ESTIMATION 


COMPARISON 

DOMESTIC 

FOREIGN 

i 

JL 


PRODUCTION 

REPORTS 



ACCURACY 

ASSESSMENT 



FIELD DATA 
FROM 
U.S. 
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GENERAL^ M PLEME N T ^]QO_N_AN D_ DATA _F LOW_ 

r.K. B ..T r,»T,T T~ DATA OPERATIONS T DATA PRODUCTS”! 

INPUT DATA PREPROCESSING | A ND ANALYSIS I AND EVALUATION 


LANDSAT 

1, 

NASA 

1 

NASA - USDA - 

1 

USDA USER 

MULTI- 

1 

GSFC 

1 

NOAA 

1 

EVALUATION 

SPECTRAL 

r 

i 


1 

— H 

AREA 

✓ ESTIMATION 

1 

-i! 1 

WASHINGTON, 

D.C. 

1 


I NOAA 


CROP 

PRODUCTION 

CCTIRII A TCP 


CROP 
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LANDSAT DATA ACQUISITION 


DATA' 
REQ , 



just BJrr>T1] 
ctr 0 Eciaa 

.aSJE3_ full 

USDA SALT ^ 

LAKE CITY 

9- BY 9-IN 
COLOR-IR 


FULL FRAMEL 


GSFC 


} COMPOSITES 

JSC 

/ seg\ 

DATA BASE 

~hj 

FOR ANALYSIS 




EARTH 


• CLOUD COVER 

• SEGMENT EXTRACTION 

• REGISTRATION 


GROUND 

STATIONS 
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ANALYSIS STEPS AND FLOW OF DATA - AREA 


LANDSAT PRODUCTS 


ANCILLARY PRODUCTS 


I 4 


TO PRODUCTION 
ESTIMATION 


ANALYST 



SEGMENT 

REPORT 

PERCENT 

WHEAT 


ANALYST 

• LABELS TRAINING 
PIXELS (-80) 



COMPUTER/DIGITAL 
DATA BASE 

• IDENTIFIES 

WHEAT IN FULL 
LANDSAT SEGMENT 
(23 000 PIXELS) 
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ANALYSIS STEPS AND FLOW OF DATA 
CROP CALENDAR MODELS 

/terminaiA 

( NOAA \ 

\ CCEA / 

X MISSOURI 



SURFACE 

WEATHER 

DATA 




MET STATION 
CROP DEV 
STAGE 


TERMINAL 


BIWEEKLY 


• AVG DAILY TEMP 

• DAILY MAX AND 

MIN TEMP 



NOAA 

PREPROCESSING x 
WASHINGTON, D.C. 


LACIE ANALYSTS 


SAMPLE SEG 
CROP DEV STAGE 




MARYLAND 


• YIELD ESTIMATES 

• YIELD ERROR 

ESTIMATES 

• MONTHLY 


METEOROLOGICAL DATA 

• MONTHLY AVG TEMPERATURE 
AND TOTAL PRECIPITATION 


TERMINAL 


NOAA 

PREPROCESSING 

y 

WASHINGTON, D.C. 


TO PRODUCTION AGGREGATION 
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STRATA 

ESTIMATES 

VARIANCE 

ESTIMATES 


ANALYSIS AND DATA FLOW - PRODUCTION ESTIMATION 


DATA-BASES 

SEGMENT 

ESTIMATES 

SMALL- 

GRAINS 

RATIOS 



INTERACTIVE 

AGGREGATION 

SYSTEM 


COUNTRY 

ANALYST 


CROP 

CONDITION 

REPORTS 


REPORTS 

• MONTHLY 

• UNSCHEDULED 

• ANNUAL 

CONTENT 

• ESTIMATES 

- PROD. 

- AREA 

- YIELD 

- CONF 

• CROP CONDITION 

• DATA USED 

• NEW PROCEDURES 


• USER EVALUATION 

* ACCURACY ASSESSMENT 
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FIELD DATA ACQUISITION 



SEGMENT SELECTION 


INTENSIVE TEST SITES 34 

A 

BLIND SITES 192 

• 18-DAY OBSERVATIONS 

® 18-DAY OBSERVATIONS 

• COMPLETE INVENTORY 
' ■ 

^ B 

• COMPLETE INVENTORIES 


DATA 
ACQUISITION 



GROUND 

TRUTH 


JSC FOR 

ACCURACY ASSESSMENT 
RESEARCH & DEVELOPMENT 
TEST & EVALUATION 
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ACCURACY ASSESSMENT 


SRS, FAS, 
& FOREIGN 
REPORTS 


LACIE 

REPORTS 


FIELD 

DATA 


PRODUCTION, AREA, YIELD 
COMPARATIVE ANALYSIS 


DATA 

MATCHING 


5 


STATIS- 

TICAL 

TESTS 


AA REPORTS 

90/90 EVALUATIONS 
COMPARISONS WITH 
REFERENCE 
STANDARDS 
ERROR SOURCE 
STUDIES 


l 


CLASSIFY 


CROP 


IDENTIFIED TECHNICAL 

CATION 


CALENDAR 


ISSUES AND 

RESULTS 


ESTIMATES 


VERIFIED TECHNOLOGY 
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INTEGRATION AND CONTROL 

• SOURCES-OF DESIGN INPUTS 

• USER REQUIREMENTS 

• R&DANDT&E 

• PEER REVIEWS 

• PROCEDURE CHANGES 

• SYSTEMS ENGINEERING 

• CONFIGURATION CONTROL BOARDS 

• VERIFICATION TESTS 

• QUALITY ASSURANCE 

® OPERATIONS 

• OPERATIONS PLANNING 

• READINESS REVIEWS 

• PAPER SIMULATIONS 

• QUALITY ASSURANCE 

• OPERATIONS CONTROL CENTER 


>-78-16515 DESIGN chronology 

• PHASE I 

• BRING INITIAL COMPONENTS ON-LINE 

• IDENTIFY PRESSING ISSUES 

• MAKE NEAR-TERM IMPROVEMENTS 

• PHASE n 

• EXPAND TO ADDITIONAL REGIONS 

• AREA, YIELD, PRODUCTION ESTIMATES 

• EVALUATE NEAR-TERM IMPROVEMENTS 

e PHASE nr 

• FULL-COUNTRY U.S.S.R. AND USGP 

• SPRING WHEAT. 

• SECOND-GENERATION TECHNOLOGY 
PHASE I i 

PHASE E i 

r r PHASE IH 


1974 1975 1976 1977 1978 

CY 
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PHASE in STUDY AREAS 
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TYPICAL LACIE LANDSAT DATA 
LOAD - MID-PHASE IK 

SUMMARY 

• 3000 DIGITAL SEGMENT ACQUISITION 

• 300/DAY INTO GSFC 

® 110/DAY PREPROCESSED THROUGH GSFC 

• 330 IMAGES/DAY PROCESSED PHOTOGRAPHICALLY 

• 18 000 DIGITAL ACQUISITIONS IN DATA BASE 

• 3000 SEGMENT DATA PACKAGES 

• 700 SEGMENTS IN WORK (AVERAGE) 

• 1000 NEW DATA PRODUCTS GENERATED PER DAY 
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NASA-S-78-1 6516 


PHASE I STUDY AREAS 




AREAS OF LACIE ANALYSIS 


(w) WHEAT-PRODUCING AREAS 
W OF INTEREST TO LAC1E 


NASA-S-78-1 651 7 


PHASE n STUDY AREAS 



□ 


AREAS OF LAC1E ANALYSIS 

W) WHEAT-PRODUCING AREAS 
OF INTEREST TO LACIE 
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NASA-S-78-1 6521 


SCOPE 


LACIE SYSTEMS OPERATIONS 


GSFC 


CAMS 

OPERATIONS 

RESOURCES 


CAMS 

OUTPUT 


2000 

ACQUISITIONS 


12 MH/ACQ 


REPORTS 


/ PHASE I ( 

^ 43 — 

1100 MACHINE 

9 

|700 SEGMENTS 

y ANALYSTS 

PROCESSINGS 

•P" 


/ PHASE n 
11700 SEGMENTS 


54 

ANALYSTS 


9000 

ACQUISITIONS 


2400 MACHINE 
PROCESSINGS ' 

6 MH/ACQ 


/ PHASE m 
[3000 SEGMENTS 


40 ANALYSTS 


18 000 

ACQUISITIONS 


5000 

MACHINE 

PROCESSINGS 

3 MH/ACQ 
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N AS A-S-78-1 6522 


MAJOR ACCOMPLISHMENTS 


• FIRST REMOTE-SENSING/DATA-PROCESS1NG CROP INVEN- 

TORY SYSTEM 

• FIRST-TIME TEST OF TECHNOLOGY OVER REPRESENTATIVE 

RANGE OF AGRONOMIC/CLIMATOLOGIC CONDITIONS 

• FIRST-TIME EVALUATION OF TECHNOLOGY UNDER REALISTIC 

FOREIGN SITUATIONS 

• DEMONSTRATED TIMELY AND ACCURATE PRODUCTION 

ESTIMATES FOR MAJOR WHEAT-GROWING REGIONS 

• FOCUSED KEY TECHNICAL ISSUES FOR REMOTE-SENSING 

CROP INVENTORY IN WHEAT {APPLICABLE TO OTHER CROPS) 

• OBTAINED EXPERIENCE TO SUPPORT DESIGN OF FUTURE 

OPERATIONAL SYSTEMS - 

• ESTABLISHED A BASE OF INTERAGENCY, MULTIDISCIPLINARY, 

EXPERIENCED PERSONNEL FOR ADDITIONAL REMOTE- 
SENSING AGRICULTURAL APPLICATIONS RESEARCH AND 
DEVELOPMENT 
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^ 79- 14466 


SYSTEM IMPLEMENTATION AND OPERATIONS SESSION 


ACQUISITION AND PREPROCESSING OF LANDSAT DATA 
L. Brown, GSFC 
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N ASA-S-78-1 6598 


ACQUISITION AND PREPROCESSING OF 
LANDSAT DATA 


N ASA-S-78-1 6599 


DAPTS/LACIE AT GSFC 
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N AS A-S-78-1 6600 


LANDSAT DATA ACQUISITION AND PROCESSING 


WBVT 

DIGITIZING 


DIGITAL 

SUBSYSTEM 


COVERAGE 

REQMTS 


OPERATIONS 

CONTROL 

CENTER 


ATTITUDE l 
& ORBIT , 
v DATA / 


WBVT * 


INFORMATION 

& production! 

CONTROL 

SYSTEM 


'ANNOTA- 
TION & 
EARTH 
V MODEL - 


FULL- \ 
FRAME 
COTS**/ 


INITIAL IMAGE 
GENERATION 
SUBSYSTEM 


70 mm 
IMAGERY 


* WIDE-BAND VIDEO TAPE 
** COMPUTER- COMPATIBLE TAPE 


N ASA-S-78-1 6601 


LACIE DATA 
ACQUISITION 
AND PROCESSING 


HIGH- 
DENSITY 
t TAPE , 


JSC 

REQMTS 


WBVT 

DIGITIZING 


LANDSAT 

OPERATIONS 

CENTER 


/ORBIT AND 
ATTITUDE 
\ DATA j 


J data 

1 LABORATORY 


/ANNOTA-\ 
f TION AND 
l EARTH 

Vmodel * 


DIGITAL 

SUBSYSTEM 


SEARCH 

AREA 

CCT'S j 


IMAGE 

PROCESSER 

REPORT 

PROCESSOR 


REPORT 

TAPE 


REPORT INFORMATION 
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N AS A-S-78-1 6602 


INCREASED THROUGHPUT ENHANCEMENTS 

• OPERATIONS CONTROL CENTER 

• VIDEO TAPE DIRECTORY IDENTIFYING ONLY LACIE 

INTERVALS 

• DATA SERVICES LABORATORY 

• ELIMINATION OF IN-TRACK OVERLAP AREAS 

• DIGITAL SUBSYSTEM 

• AUTOMATIC CLOUD SCREENING 

• MULTIPLE PASSES OF INPUT DATA TO PERMIT OVERLAPPING 

OF AREAS 

• GENERAL-PURPOSE IMAGE PROCESSOR 

• IMPROVED CORRELATION AND STATISTICAL EVALUATION 

• ELIMINATION OF VISUAL SCREENING 

c CLOUD EDGE AND SHADOW DETECTION 


N ASA-S-78-1 6603 

OPERATIONAL EFFICIENCY ENHANCEMENTS 

• GENERATION OF USDA FILM WORK ORDERS 

• REMOVAL OF VISUAL SCREENING 

• QUALITY ASSURANCE FILM LIBRARY AND PROCESSING PROCE- 

DURES ESTABLISHED 

• ADDITIONAL DISK RESOURCES IN DATA SERVICES LABORATORY 

• TRANSMISSION TO JSC VIA LAND LINES 

• STREAMLINING INTERFACE OF ATTITUDE AND ORBIT DATA 
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NASA-S-78-16604 




GSFC PERFORMANCE SUMMARY 



OCT 75- 
SEPT 76 
PHASE H 

OCT 76- 
SEPT 77 

phase in 


ACQUISITIONS 

7380 

31 296 

63 568 


SEARCH AREAS 
EXTRACTED 

3979 

15 676 

30 438 


SAMPLE SEGMENTS 
TRANSMITTED 
TO JSC 

2602 

10 645 

22 718 


CLOUD/SNOW 

REJECTIONS 

39% 

52% 

49% 


CORRELATION 

REJECTIONS 

14% 

9% 

4% 


MISCELLANEOUS 

REJECTIONS 

12% 

5% 

11% 
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SYSTEM IMPLEMENTATION AND OPERATIONS SESSION 


% N79-14467 


CLASSIFICATION AND MENSURATION - AN APPROACH 
TO LANDSAT DATA ANALYSIS FOR CROP 
IDENTIFICATION 
R. Bizzell, JSC 


Original photography' may fie fior chased tiGSBa 
EROS Data Center 

Sioux Falls, SD .$“) I ^ 
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CLASSIFICATION AND MENSURATION - 
AN APPROACH TO LANDSAT DATA 
ANALYSIS FOR CROP IDENTIFICATION 


NAS A-S-78-1 6922 

CLASSIFICATION 
AND MENSURATION SUBSYSTEM 

• AREA ESTIMATION 

• CLASSICAL CLASSIFICATION 

• LACIE RULES 

• NO GROUND TRUTH 

• INTERPRETATION OF LANDSAT IMAGERY 

• OPERATIONAL ENVIRONMENT 
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OPS FLOW 
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N ASA-S-78-1 2505 


INTERPRETATION PRODUCTS 
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PRODUCT 1 
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PRODUCT 2 
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COMPARISON OF PRODUCT 1 AND 3 
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MODIFIED 
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N ASAS-78-1 6926 

REFERENCE PRODUCTS 

• DETAILED ANALYSIS PROCEDURES 

• CROP CALENDAR 

• METEOROLOGICAL SUMMARIES 

• AGRICULTURAL STATISTICS 

• FULL-FRAME IMAGERY 

• CROPPING PRACTICES 

• MAPS 

• ANALYST INTERPRETATION KEYS 



NASA-S-78-1 2514 


U.S. MIXED WHEAT 

FULL LANDSAT FRAME JULY 3, 1977 
LACIE SEGMENT 1528, BLAINE, MONTANA 

mmw ' '• zh 
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N ASA-S-78-1 6927 

INTERPRETATION VARIABLES 

• REGION 

• FIELD SIZE 

• ACQUISITION HISTORY 

• SIGNATURES 

0RIGINAE PAGE IS 

• EPISODIC EVENTS QE EOOR QUALITY 

• CONFUSION CROPS 

• REGISTRATION 
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COMPARISON OF FIELD SIZES 




U.S.S.R. 

m 


US. 


. r ' b 

#■' \4H* 

i^riv^ .. su«i 

JUNE 23, 1977 LARGE FIELDS 

.<• 


\ A ^ ’ ’ * 

■v*ri 

l VTT* s* 

-? • -x*-- r„ 

JUNE 24, 1977 
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AUG 28, 1976 


SMALL FIELDS 


r. 14 J>' 

JUNE 20, 1976 
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NASA-S-78-16930 


MAY 1 


CROP CALENDAR 

JUNE 6 JUNE 24 


JULY 30 
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NASA-S-78-12503 

VARIABILITY OF WHEAT SIGNATURES 



KIOWA, OK JAN 18, 1976 BAYLOR, TEX NOV 24, 1975 

DROUGHT STRESS CONDITIONS 



NASA-S-78-1 2507 


LACIE BLIND SITE EXAMPLE 

COLOR INFRARED PHOTOGRAPH, 31 MAY 1977 

HETTINGER, N.D., SEG 1913, INVENTORY 2-3 AUG 

' i i *4L v 


SPRING 

WHEAT 


WINTER 

WHEAT 


FIELDS 
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LABELING 


BLAINE, A 
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NASA-S-78-12513 

LABELING EXAMPLE 

BLAINE, MONTANA 



FIELDS 
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NASA S-78 16932 

MACHINE PROCESSING 

BATCH 


• CLUSTERING 

• AUTOMATIC CLUSTER LABELING 

• CLASSIFYING 

• PERFORMING STRATIFIED AREAL 

ESTIMATION 

• GENERATING EVALUATION PRODUCTS 

• CLUSTER MAPS 

• CLASS MAP 

• CLASS SUMMARY 

• SPECTRAL AIDS 



NASA-S-78-12510 


LACIE 16 CHANNEL CLASSIFICATION PRODUCTS 

BLAINE, MONTANA 

. ' ACQUISITION DATES 


'«* 1 

r • 




PLAIN CLUSTER MAP 


APRIL 22, 1977 
MAY 28, 1977 
JULY 3, 1977 
AUG 8, 1977 
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N ASA-S-78-1 6933 


SPECTRAL SCATTER PLOT 

FINNEY COUNTY, KANSAS 



PLOT IMAGE 


N ASA-S-78-1 6934 


ANALYST AID - SCATTER PLOT 


• 

GREENNESS 

• 

•• • 

• o °o 

• ° • O O • 

• o 
• • . 

o • • 

* o • 

°o °° 


o 

• 

o 


BRIGHTNESS 
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NASA-S-78-1 6937 

QUALITY ASSURANCE 


• PROCEDURES 


• DOT LABELS 

6 

1 

• WHEAT/SMALL GRAINS 
ESTIMATE 


NAS A-S-78-1 6938 


ACCOMPLISHMENTS 

• THROUGHPUT 

• TECHNOLOGY 

• VARIABILITY 
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N ASA-S-78-1 6940 


INITIAL FUNCTIONAL FLOW 


I 

1 

I 

I 

I 


MANUAL FUNCTIONS 


SCREENING 


MACHINE FUNCTIONS 


DATA QUALITY CHECK 


ACQUISITION SELECTION 


TRAINING DATA DEFINITION 


SPECTRAL CLASS 
DELINEATION AND LABELING 


DEFINE FIELD VERTICES 


PREPARE BATCH JOB 



DATA BASE UPDATING 


MACHINE PROCESSING 


INTERACTIVE PROCESSING 


HANDCOUNTS FOR LOW WHEAT 



CLASSIFICATION 


SUMMARY REPORT GENERATION 


II 


EVALUATION OF RESULTS 


EXAMINE TRAINING AND TEST 
FIELDS CLASSIFICATION 
PERFORMANCES 
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NASA-S-78-1 6941 PROCEDURE 1 FUNCTIONAL FLOW 


MANUAL FUNCTIONS 


-t h 


SCREENING 


MACHINE FUNCTIONS 


-l 


TRAINING DATA DEFINITION 
-t t 


-i *- 


-e lr 


DATA BASE UPDATING 




DOT VERTICES PRESTORED 


-t b- 


MACHINE PROCESSING 


* 

CLUSTERS GEN & LABELED FROM DOTS 

1 


- - ^-CLASSIFICATION. . 


SPECTRAL PLOT GENERATION 

1 


STRATIFIED AREAL SAMPLE CALC 


EVALUATION OF RESULTS 
* 


SUMMARY REPORT GENERATION 


-t i- 
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SYSTEM IMPLEMENTATION AND OPERATIONS SESSION 


IMPLEMENTATION AND OPERATION OF YIELD FORE- 
CASTING AND CROP GROWTH STAGE ESTIMATION 
D McCrary, NOAA 
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NASA-S-78-16942 


IMPLEMENTATION AND OPERATION OF 
YIELD FORECASTING AND 
CROP GROWTH STAGE ESTIMATION 
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NASA-S-78-16944 YES OPERATIONS 

METEOROLOGICAL DATA 


YES PRODUCTS 


ASSESSMENT OF CCEA 
WASHINGTON, D.C. 


PROCESSED DATA 

f 


MODELING OF CCEA 
COLUMBIA, MO 



SPACE FLIGHT METEOROLOGY OFFICE 
NASA JSC HOUSTON, TEX 


CROP DATA 

USDA - NOAA 

CROP WEATHER SUMMARIES 

WEEKLEY WEATHER AND 
CROP BULLETIN 

FOREIGN CIRCULAR 



• YIELD 

ESTIMATES 

• ADJUSTABLE 

CROP 

CALENDARS 

• CROP 

CONDITION 

ASSESSMENTS 

• WEATHER 

SUMMARIES 

• EPISODIC 

EVENTS 

• ANALYST 

BRIEFINGS 


N ASA-S-78-1 6945 



ANALYSIS STEPS AND FLOW OF DATA -YIELD 


TERMINAL 

, CCEA 

\ / 

MISSOURI 


• YIELD ESTIMATES 

• YIELD ERROR 

ESTIMATES 
• MONTHLY 





MARYLAND I 

/ 

METEOROLOGICAL DATA 


MONTHLY AVG TEMPERATURE 
AND TOTAL PRECIPITATION 


NOAA 

PREPROCESSING [/ 
WASHINGTON, D.C. 


TERMINAL 

JSC 


TO PRODUCTION AGGREGATION 
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ANALYSIS STEPS AND FLOW OF DATA 
CROP. CALENDAR MODELS 

/terminal\ 

( NOAA ) ^ 

\ CCEA / 

/ MISSOURI 


mi 

SURFACE 

WEATHER 

DATA 



MET STATION 
I CROP DEV 
STAGE 

• BIWEEKLY 


• AVG DAILY TEMP 

, • DAILY MAX AND 
MIN TEMP 


TERMINAL 



-NOAA 

PREPROCESSING , 
WASHINGTON, D.C. 


LANDSAT ANALYSTS - 


SAMPLE' SEG 
CROP DEV STAGE 


NASA-S-78-16947 


MONTANA 


/ / !/ 

! i57i 

,a / / m . 


NORTH DAKOTA 


1651 - 2 JA 
1667 - 2.7B / - 


1668 - 2.88 



SOUTH DAKOTA 


WYOMING 


' NEBRASKA 


JUNE 8 JUNE 
/ / 


!\ III 

JNE 6 JUNE 5 / / 

11 / / / 


* 
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N ASA-S-78-1 6948 



NASA-S-78-16949 

WEEKLY METEOROLOGY SUMMARY 

• TEMPERATURE AND PRECIPITATION MAPS 

• TEMPERATURE AND PRECIPITATION DATA WITH DEPARTURES 

• STATE WEATHER AND CROP ASSESSMENT 

• CROP MOISTURE INDEX, MAY 27, 1978 

• AVERAGE SOIL TEMPERATURE, MAY 22-28, 1978 

« 1 < 

• TOTAL GROWING DEGREE DAYS, MARCH 1 - MAY 28, 1978 
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N AS A-S-78-1 6954 


YIELD ESTIMATION SUBSYSTEM 

ACCOMPLISHMENT 


• OPERATION SYSTEM TO COLLECT AND PROCESS METEOR- 

OLOGICAL DATA FROM ALL LACIE COUNTRIES 

• WEEKLY WEATHER SUMMARIES WERE PRODUCED FOR ALL 

LACIE COUNTRIES 

• DAILY WEATHER REPORTS FROM 300 STATIONS IN 7 LACIE 

COUNTRIES WERE PROCESSED TO PROVIDE TEMPERATURE 
VALUES TO OPERATE THE CROP CALENDARS 

• YIELD ESTIMATES IN LAST 12 MONTHS WERE PRODUCED FOR 

306 AREAS IN 7 DIFFERENT COUNTRIES 
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SYSTEM IMPLEMENTATION AND OPERATIONS SESSION 


N 79 - 14469 


SYSTEM IMPLEMENTATION AND APPROACHES USED FOR 
GENERATION OF CROP PRODUCTION REPORTS 
R Hatch, USD A 
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N AS A-S-78-1 6955 


SYSTEM IMPLEMENTATION AND APPROACHES 
USED FOR GENERATION OF 
CROP PRODUCTION REPORTS 


N ASA-S-78-1 6956 

THE CROP ASSESSMENT SUBSYSTEM - 
GENERATION OF CROP PRODUCTION REPORTS 

• SUBSYSTEM FUNCTIONS 

• SUBSYSTEM DESIGN CONSIDERATIONS 

• REPORT CONTENT, SECURITY, AND DISTRIBUTION 

• SYSTEM IMPLEMENTATION AND OPERATIONS 

• MAJOR ACHIEVEMENTS 


131 
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N ASA-S-78-1 6957 


SUBSYSTEM FUNCTIONS 

• OVERALL RESPONSIBILITY FOR SAMPLING STRATEGY 

• ALLOCATION OF SAMPLE SEGMENTS TO SAMPLING 

UNIT 

• LOCATION OF SAMPLE SEGMENTS WITHIN SAMPLING 

UNIT 

• PRODUCE SCHEDULED CROP REPORTS (USUALLY 

MONTHLY) DURING THE CROP SEASON THAT INCLUDE: 

• ESTIMATES OF WHEAT AREA, YIELD, AND PRODUCTION 

• STATISTICAL DESCRIPTORS FOR EACH ESTIMATE 


NASA-S-78-16958 

SUBSYSTEM DESIGN 

• SAMPLING STRATEGY SELECTED 

• DICTATES THE AGGREGATION METHODOLOGY 

• PROVIDES BASIS FOR FORMULATING STATISTICAL 

DESCRIPTORS TO EVALUATE THE ACCURACY AND 
RELIABILITY OF ESTIMATES 

• AGGREGATION SYSTEM DESIGNED TO USE A STRAT- 

IFIED RANDOM SAMPLE FOR WHEAT AREA ESTIMA- 
TION AT THE STRATUM LEVEL 

• AREA ESTIMATES COMBINED WITH INDEPENDENT 

YIELD ESTIMATE TO OBTAIN PRODUCTION 

• INTERACTIVE SYSTEM DESIGN DEEMED NECESSARY 

TO 

• PROCESS ANTICIPATED DATA LOADS FOR EIGHT 

COUNTRIES 

• PROVIDE CHOICE OF OUTPUT PRODUCTS FOR USE 

IN ACCURACY ASSESSMENT AND EVALUATION 

• PROVIDE ADDITIONAL OPTIONS FOR USE IN EVAL- 

UATING THE IMPACT OF PROCEDURAL CHANGES 
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BASIC INPUT DATA 

• SAMPLE SEGMENT WHEAT PROPORTION ESTIMATES 

• YIELD AND YIELD VARIANCE FOR STRATA 

• HISTORICAL CROP STATISTICS 

• DATA ARE STORED FOR USE BY AGGREGATION AND 

REPORTING MODULES 

• PREPROCESSOR USED TO REFORMAT BEFORE STORAGE 

WHERE REQUIRED 


N ASA-S-78-1 6960 


ANALYSIS AND DATA FLOW - PRODUCTION ESTIMATION 



DATA BASES 

SEGMENT 

ESTIMATES 

SMALL- 

GRAINS 

RATIOS 

YIELD 

- STRATA 
ESTIMATES 
VARIANCE 
ESTIMATES 

HISTORICAL 

- CROP 
STAT 


ANCILLARY 

DATA 


INTERACTIVE 

JAGGREGATION 

SYSTEM 



COUNTRY 

ANALYST 


CROP 

CONDITION 

REPORTS 


REPORTS 

• MONTHLY 

• UNSCHEDULED 

• ANNUAL 

CONTENT 

• ESTIMATES 

- PROD. 

- AREA 

- YIELD 

- CONF 

• CROP CONDITION 

• DATA USED 

• NEW PROCEDURES 


• USER EVALUATION 

• ACCURACY ASSESSMENT 
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SEGMENT DATA INPUT 

• SAMPLE SEGMENT CLASSIFICATION RESULTS USED FOR AREA 

EXPANSION WERE SUPPLIED BY CAMS 

• CLASSIFICATION RESULTS TRANSMITTED VIA COMPUTER 

CARDS WITH SPECIFIC FORMATS TO: 

• ACCOMMODATE LARGE DATA LOADS 

• MINIMIZE TRANSCRIPTION ERRORS 

• DATA TRANSMITTED 

• FIVE POSSIBLE CLASSES - WINTER WHEAT, SPRING WHEAT, 

WINTER SMALL GRAINS, SPRING SMALL GRAINS, AND 
SMALL GRAINS 

• OTHER INFORMATION - DATE SEGMENT ACQUIRED, DATE 
' SEGMENT CLASSIFIED, CROP DEVELOPMENT BIOSTAGE, 

CLASSIFICATION CODE 

• SMALL-GRAINS RATIOS APPLIED TO CLASSIFICATION RESULTS 

BEFORE ENTRY INTO THE SEGMENT-LEVEL DATA BASE - 
CREATES TWO MORE CLASSES (RATIOED WINTER WHEAT 
AND RATIOED SPRING WHEAT) 


N ASA-S-78-1 6962 


SEGMENT INPUT DATA (CONT) 

• CLASSIFICATION RESULTS QUALITATIVELY EVALUATED AS 

UNSATISFACTORY, MARGINAL, OR SATISFACTORY STORED 
IN DATA BASE 

• SEGMENTS NOT CLASSIFIED (PREEMERGENCE, CLOUD COVER, 

DORMANCY) WERE NOT STORED 

• DATA EDITING PROCEDURES USED IN PHASE 3H (1976-77 CROP 

YEAR) 

• EARLY-SEASON ESTIMATES THAT DID NOT DETECT ALL 

PLANTED WHEAT WERE ELIMINATED FROM AGGREGATION 

• SEGMENT ESTIMATES THAT WERE OUTLIERS WERE ELIMIN- ' 

ATED FROM AGGREGATION 
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NASA-S-78-16963 

YIELD DATA INPUT 

• YIELD AND YIELD VARIANCE WERE SUPPLIED FOR EACH 

STRATUM BY YES 

• YIELDS WERE GENERALLY SUPPLIED MONTHLY DURING 

THE GROWING SEASON 

• U.S - FOURTH WORKING DAY 

• U.S.S R. AND CANADA - NINTH WORKING DAY 

• INTERACTIVE SYSTEM ORIGINALLY DESIGNED FOR 

MAGNETIC-TAPE INPUT 

• UNAVAILABILITY OF DATA TERMINAL AT JSC REQUIRED 

ADDITIONAL INPUT CAPABILITY - COMPUTER CARD 
AND INTERACTIVE 

• DATA STORAGE KEYS - YIELD STRATUM AND MONTH 

RECEIVED 

• YIELD AND AREA STRATA CORRELATED BY AGGREGATION 

SOFTWARE IN PRODUCTION ESTIMATION PROCESS 


NASA-S-78-1 6964 


HISTORICAL DATA INPUT 

• HISTORICAL AGRICULTURAL STATISTICS FOR POLITICAL 

SUBDIVISIONS USED FOR AREA ESTIMATION AND 
STATISTICAL CALCULATIONS WERE SUPPLIED BY DAPTS 

'• INTERACTIVE SYSTEM DESIGNED FOR MAGNETIC-TAPE OR 
COMPUTER-CARD INPUT 

• AGRICULTURAL STATISTICS NOT READILY AVAILABLE 

FOR ALL COUNTRIES AND MUST BE MADE COMPUTER 
COMPATIBLE 

• THE FOLLOWING DATA ARE STORED (COMPLETE SET 

AVAILABLE FOR U S ONLY) 

• BASE YEAR FOR RATIO AREA ESTIMATION AND 

STATISTICAL CALCULATIONS (REQUIRED FOR 
AGGREGATION) 

• SECOND YEAR OF HISTORICAL DATA REQUIRED TO 

SUPPORT STATISTICAL CALCULATIONS 

• AREA, YIELD, AND PRODUCTION FOR 12 YEARS STORED 

FOR ALL HIERARCHICAL LEVELS IN A COUNTRY 

• HISTORICAL DATA ACCESSED FOR REPORT GENERATION 

AND THE MAXIMUM, MINIMUM, AVERAGE, AND STAND- 
ARD DEVIATION OF AREA, YIELD, AND PRODUCTION 
AT EACH HIERARCHICAL LEVEL ARE REPORTED 


135 






NASA-S-78-1 6965 


ANCILLARY DATA 


• ANCILLARY DATA OBTAINED FROM NUMEROUS SOURCES 

• NEWSPAPERS 

• WEATHER AND CROP SUMMARIES 

• USDA REPORTS 

• USED BY ANALYST TO 

• EVALUATE DATA INPUTS AND AGGREGATED RESULTS 

• IDENTIFY POTENTIAL PROBLEM AREAS 

• SUPPORT GENERAL CROP CONDITION ASSESSMENT 


NASA-S-78-1 6966 


SUBSYSTEM OUTPUTS 

• PRIMARY PRODUCT WAS CROP REPORTS CONTAINING 

ESTIMATES OF WHEAT AREA, YIELD, AND PRODUCTION 

• REPORT CONTENT AND FORMAT ESTABLISHED TO SATISFY 

USER REQUIREMENTS AND SUPPORT EVALUATION OF 
RESULTS 

• CROP REPORTS WERE COMBINATION OF COMPUTER OUT- 

PUT AND NARRATIVE ANALYTICAL SUMMARY 

• COMPUTER OUTPUT TABLES 

• AREA, YIELD, AND PRODUCTION FOR ALL HIERARCHICAL 

LEVELS IN A COUNTRY 

• STANDARD STATISTICS FOR EACH ESTIMATE 

• MINIMUM, MAXIMUM, AVERAGE, AND STANDARD DEVIA- 

TION OF HISTORICAL DATA 

• NARRATIVE 

• SUMMARY OF ESTIMATES 

• DISCUSSION OF SAMPLE SEGMENT DATA 

• YIELD TRACKING AND ANALYSIS 

• CROP CONDITION ASSESSMENT BASED ON ANALYSIS OF 

METEOROLOGICAL AND LANDSAT DATA 
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NASA-S-78-1 6967 

REPORTS 

• SCHEDULE ' 

• PHASE I REPORTS SCHEDULED FOR LAST WORKING DAY OF 

THE MONTH 

• PHASE 31 

- U.S. REPORTS RELEASED DAY BEFORE USDA RELEASE OF 

CROP PRODUCTION ESTIMATES 

- FOREIGN REPORTS RELEASED 7 WORKING DAYS AFTER 

RECEIPT OF YIELD 

• PHASE HI 

- U.S. - SAME AS PHASE H 

- U.S.S.R. - RELEASED TO SUPPORT U.S.S.R. GRAIN SITUATION 

TASK FORCE MEETING (NORMALLY FIRST WEEK OF 
MONTH) 

• REPORTS TRANSMITTED DURING LAC1E 

• 32 MONTHLY REPORTS 

• 7 UNSCHEDULED REPORTS 

• 6 ANNUAL REPORTS 
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REPORTS (CONT) 

• REPORTS WERE COUNTRY SPECIFIC 

• PHASE I 

- U.S. GREAT PLAINS - 6 AREA REPORTS GENERATED; 5 NOT 

DISTRIBUTED 

• PHASE H 

-US GREAT PLAINS - 13 REPORTS 

- U.S.S.R. INDICATOR REGIONS - 8 REPORTS 

' - CANADA - 4 REPORTS 

• PHASE m 

- U.S. GREAT PLAINS - 10 REPORTS 

- U.S.S.R. - 9 REPORTS 


137 





NASA-S-78-1 6969 

REPORT SECURITY AND DISTRIBUTION 


• COMMODITY INFORMATION CONTROLS COMPLIED WITH USDA 

PROCEDURES 

• ESTIMATES PRODUCED IN CONTROLLED-ACCESS AREA WITH 

USER IDENTIFICATION CODE AND PASSWORD PROTECTED 
COMPUTER FILES 

• MAXIMUM SECURITY - DAY AFTER OFFICIAL USDA RELEASE 

• RESTRICTED SECURITY - 120 DAYS FROM MAXIMUM 

• REPORTS DISTRIBUTED TO 

• ACCURACY ASSESSMENT, HOUSTON 

• INFORMATION EVALUATION, USDA/LACIE, WASHINGTON, 

D.C. 

• PARTICIPATING AGENCIES FOR EVALUATION: 

- NASA, WASHINGTON, D.C. 

- NOAA, WASHINGTON, D.C. 

- USDA, WASHINGTON, D.C. 

• ANALYST PRESENTED LATEST AVAILABLE ESTIMATES AT 

U.S.S.R. GRAIN SITUATION TASK FORCE MEETINGS DURING 
PHASE nr 


NASA-S-78-1 6970 

SYSTEM IMPLEMENTATION 

• OPERATIONAL AGGREGATION AND REPORTING SYSTEM 

EVOLVED 

• STAGE OF IMPLEMENTATION DETERMINED ANALYTICAL AND 

REPORTING CAPABILITIES 

• PHASE I 

• EMPHASIS ON DEVELOPMENT OF SYSTEM REQUIREMENTS 

• DEVELOPMENT SOFTWARE IMPLEMENTED FOR USGP 

• PRODUCED WHEAT AREA ESTIMATES WITH COEFFICIENT OF 

VARIATION 

• FORMATTED OUTPUT FOR CROP REPORTING DISTRICTS 

AND STATES 

• PHASED 

• BATCH SYSTEM INITIALLY AVAILABLE FOR AREA, YIELD, 

AND PRODUCTION WITH STATISTICAL DESCRIPTORS FOR 
USGP, U.S.S.R., AND CANADA 

• PARTIAL INTERACTIVE SYSTEM DELIVERED IN MIDYEAR 

• HYBRID BATCH/INTERACTIVE SYSTEM USED FOR REMAIN- 

DER OF YEAR 

• PHASE m 

• INTERACTIVE SYSTEM WITH FULL CAPABILITY BECAME 

AVAILABLE 
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NASA-S-78-16971 


FINAL INTERACTIVE SYSTEM 

• MAJOR SOFTWARE MODULES 

• DATA BASE MANAGEMENT 

• AREA, YIELD, AND PRODUCTION ESTIMATION 

• REPORT GENERATION 

• ANALYST TUTORIAL PROMPT SYSTEM TO MINIMIZE 

TRAINING AND OPERATIONAL COMPLEXITY 

• FOUR ANALYSTS STATIONS OPERATED SIMULTANEOUSLY 

• CAPABLE OF PRODUCING TIMELY AGGREGATIONS 

• USED FOR TECHNOLOGY DEVELOPMENT IN SUPPORT OF 

ACCURACY ASSESSMENT 


NASA-S-78-16972 

SUBSYSTEM OPERATIONS 

• LEAD ANALYST ASSIGNED TO EACH COUNTRY WAS RESPON 

SIBLE FOR: 

• MAINTAINING DATA BASES, PRODUCING WHEAT ESTIMATl 

AND GENERATING REPORTS 

• ESTABLISHING PROCESSING PRIORITIES FOR SAMPLE 

SEGMENTS 

• OPERATING AGGREGATION SOFTWARE 

• EVALUATING RESULTS 

• PREPARING REPORT AND INCORPORATING INPUTS FROM 

OTHER LACIE ELEMENTS 

• TIME LINE FOR REPORT GENERATION 

• BEGAN 7 WORKING DAYS BEFORE REPORT DATE 

• UPDATE DATA BASES 

• PRELIMINARY AGGREGATION PREPARED (SUBMITTED IF 

PRIMARY AND BACKUP COMPUTERS FAILED) 

• FINAL AGGREGATION AND PREPARE REPORT (24-72 HR) 

• LEAD TIME DECREASED TO 3 WORKING DAYS UNDER 

SPECIAL CIRCUMSTANCES TO INCLUDE LATEST DATA 
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SUBSYSTEM OPERATIONS (CONT) 

• REPORT INTERACTION 

• INFORMATION EVALUATION AND ACCURACY 

ASSESSMENT RETURNED REPORT EVALUATION 
TO SUBSYSTEM 

• PROBLEMS IDENTIFIED DURING REPORT PREPAR- 

ATION WERE REWORKED WITH RESPONSIBLE 
PROJECT ELEMENT 

• COUNTRY ANALYSTS BRIEFED PROJECT PERSONNEL 

ON RESULTS 
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MAJOR ACHIEVEMENTS 

• IDENTIFIED BASIC ELEMENTS NECESSARY TO PRODUCE 

CROP REPORTS ROUTINELY REGARDLESS OF THE 
OPERATIONAL ENVIRONMENT 

• DEMONSTRATED THAT CROP REPORTS COULD BE PRODUCED 

MONTHLY AND ON SCHEDULE - 

• DEVELOPED AN INTERACTIVE SYSTEM THAT IS AVAILABLE 

FOR USE IN FUTURE LARGE-AREA TESTS 

• USED THE INTERACTIVE SYSTEM TO SUPPORT EVALUATION 

TASKS AND RAPIDLY IMPLEMENT MODIFICATIONS TO 
AGGREGATION PROCEDURES 





SYSTEM IMPLEMENTATION AND OPERATIONS SESSION 


ACCURACY ASSESSMENT - SYSTEM IMPLEMENTATION 
AND OPERATION 
D Pitts, JSC 


Original pfiotograpfiymay Be fljircbasad frosW 
EROS Data Center 

Stoux Falls, SO $"1 II 




NASA-S-78-16705 


ACCURACY ASSESSMENT - SYSTEM 
IMPLEMENTATION AND OPERATION 


NASA-S-78-1 6706 


ACCURACY ASSESSMENT 


• NEED 

• TIMELY IDENTIFICATION OF MAJOR PROBLEM AREAS AND 

RECOMMENDATIONS FOR IMPROVEMENTS 

• OBJECTIVES 

• TO DETERMINE THE ACCURACY AND RELIABILITY OF 

LACIE ESTIMATES OF PRODUCTION, AREA, AND YIELD 
MADE AT REGULAR INTERVALS THROUGHOUT A CROP 
SEASON 

• TO DETERMINE WHETHER OR NOT THESE ESTIMATES SUP- 

PORT THE 90/90 ACCURACY GOAL 

• TO INVESTIGATE THE VARIOUS ERROR SOURCES OF THESE 

ESTIMATES AND TO QUANTIFY AND RELATE THESE 
ERROR SOURCES TO CAUSAL ELEMENTS IN THE LACIE 
ESTIMATION PROCESS 
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DATA FLOW AND ANALYSIS 


SHS, FAS,,’ 
& FOREIGN 
REPORTS 
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AA REPORTING 


• A BRIEF ACCURACY ASSESSMENT QUICK-LOOK REPORT 

IS PREPARED FOR EACH LACIE CROP REPORT 

• COMPREHENSIVE ACCURACY ASSESSMENT REPORTS 

WERE PREPARED FOUR TIMES DURING THE CROP 
YEAR IN PREPARATION FOR A FINAL REPORT 
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FIELD DATA ACQUISITION 


SEGMENT 

SELECTION 


DATA 

ACQUISITION 


GROUND 

TRUTH 
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FIELD DATA ACQUISITION (CONT) 


INTENSIVE TEST SITES 
18-DAY OBSERVATIONS 

• UP TO 50 FIELDS OF 

ALL CROPS 

• COVER TYPE ? 

• CROP HEIGHT 

• % GROUND COVER 

• GROWTH STAGE 

• RAINFALL 


COMPLETE INVENTORY 

• COVER TYPE 

• FIELD SIZE 

• PLANTING DATE 

• IRRIGATION/FERTILIZER 


BLIND SITES 
18-DAY OBSERVATIONS 

• 15 WHEAT FIELDS 

• CROP HEIGHT 

• % GROUND COVER 


COMPLETE INVENTORIES 

• COVER TYPE 

♦ FALL & SPRING 


144 






NASA-S-78-1 6712 


PRODUCTION ERROR COMPONENTS 


PRODUCTION ERROR 


SAMPLING 

VARIANCE 


AREA ERROR SOURCE YIELD ERROR SOURCE 


CLASSIFI- 

CATION 

VARIANCE 


CLASSIFI- 
CATION BIAS 
(COUNTRY 
LEVEL) 


YIELD 

VARIANCE 


YIELD BIAS 


sssss 


NASAS-78-1 6711 


S • SPRING WHEAT 
W - WINTER WHEAT 
M - MIXED SPRING AND WINTER 
• - BLIND SITES 


PHASE m 

LACIE BLIND SITES 
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NASA-S-78-16713 



NASA-S-78-1 6714 


COLLECTION OF DATA FOR BLIND SITES 
AND INTENSIVE TEST SITES 
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NASA-S-78-16715 


USE OF FIELD DATA TO EVALUATE 

CLASSIFICATION ACCURACY 

DIGITIZED 


GROUND- 


TRUTH 


MAP 



ERROR 

CAMS 

AA MAGNITUDES 


SYSTEM r AND 

LABELS 

SOURCES 

CAMS 


CLASSIFICATION— J 


MAPS 



NASA-S-78-16716 


DATA QUANTITIES FOR BLIND SITES 

• ABOUT 64 000 ANALYST LABELS 

• 14 000 000 PIXELS IN CLASSIFICATION 

MAPS 

• GROUND-TRUTH INVENTORIES = 6000 

SQUARE MILES 

• THIS IS EQUIVALENT TO PRODUCING AN 
INVENTORY MAP OF THE STATE OF 
NEW JERSEY AT 1/6-ACRE RESOLUTION 
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LACIE GROUND-TRUTH DATA 


PHASE I 

• 27 U.S. INTENSIVE TEST SITES AND 2 CANADIAN INTENSIVE 

TEST SITES 

• WALL-TO-WALL INVENTORY NEAR WHEAT HARVEST 

• OBSERVATION OF CROP CONDITIONS ON ABOUT 40 

FIELDS EACH 18 DAYS 

• YIELD AND RAINFALL ON SELECTED FIELDS 

• SHORTCOMINGS 

• ITS'S CHOSEN TO INCLUDE HIGH PERCENTAGE OF WHEAT 

• TOO FEW SITES TO REPRESENT SEVERAL HUNDRED SITES 

IN USGP 

• 29 BLIND SITES CHOSEN IN MONTANA AND NORTH DAKOTA 

• WALL-TO-WALL INVENTORIES 

• PLANIMETRY USED TO DETERMINE SMALL GRAINS 

PROPORTION 
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NASA -S-78- 10904 


BLIND SITE EXAMPLE - SITE 1523 

WILKIN COUNTY, MINNESOTA - JUNE 1, 1977 
AIRCRAFT PHOTOGRAPH 
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LACIE GROUND-TRUTH DATA (CONT) 

PHASE n 

• 29 INTENSIVE TEST SITES 

• 150 BLIND SITES IN THE 9 STATES IN USGP 

• PLANIMETRY USED TO DETERMINE WHEAT 

AND SMALL GRAINS PROPORTION 
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NASA-S-78-16719 


LACIE GROUND-TRUTH DATA (CONT) 

PHASE m 

• 24 U.S. INTENSIVE TEST SITES 

• 20 CANADIAN INTENSIVE TEST SITES 

• 171 U.S. BLIND SITES 

• 15 WHEAT FIELDS CHOSEN BY FIELD OBSERVATIONS 

EACH 18 DAYS 

• 400-DOT PROCEDURE GIVES EARLY ESTIMATE OF WHEAT 

AND SMALL GRAINS 

• ALL CROP PROPORTIONS ARE DETERMINED 


NASA-S-78-10903 


BLIND SITE EXAMPLE - SITE 1523 

WILKIN COUNTY, MINNESOTA 
FIELD DELINEATIONS - CARTOGRAPH LAB 
PORTION EXPANDED 
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ORIGINAE page 
OF POOR QUAL1TV 


~ ASAS " , “’ 8 DIGITIZED GROUND TRUTH 
REGISTERED TO LANDSAT IMAGERY 
LACIE SEGMENT 1523, PHASE M, BLIND SITE 

WILKIN COUNTY. MINNESOTA 


" ■ J—%- 

l ^.-Hk -jmm 

v wzxmm 


ia 

^ ill 


‘1 

INVENTORY DATE, AUGUST 1, 1977 
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• SPRING WHEAT - SALMON PINK 

• HARVESTED SPRING WHEAT -LIGHT PINK 

• OTHER SPRING GRAINS -PINK 

• HARVESTED OTHER SPRING GRAINS - GOLD 

• OTHER CROPS (CORN, SUNFLOWER, SOYBEANS, 

SUGAR BEETS) - RED 

• PASTURE, GRASS, HAY, ALFALFA -BLUE 

• IDLE FALLOW, IDLE COVER CROPS, IDLE RESIDUE 

-GRAY 


NONAGRICULTURE (TREES, HOMESTEAD) - GREEN 
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NASA S 78 12517 

LACIE PHASE ffl, BLIND SITE 1523 

WILKIN COUNTY, MINNESOTA 

BIOWINDOW 1, BIOSTAGE 1.5 BIOWINDOW 2, BIOSTAGE 4.3 

JIM4 i*\ •* M 

v . /• - l® • k ®4 


»r 

i* 




■ 


TO . ... \W 

via . \ , - Jj 

c‘ \W 


»» • wmam 

j «« 

4/ r i 

1 


X 1 

f ■ 

« * * 


PLANTED APR 30, 1977 16 - 30 IN. WHEAT, JUNE 23, 1977 
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DOT-LABELING ACCURACY AND ESTIMATED 

PROPORTION ACCURACY 

FOR SEGMENT 1523 




SMALL GRAINS 

OTHER 

ACQUISITION 

ESTIMATED 

DOT 

DOTS 

DOTS 

DATES, 1977 

sw , 

TYPE 

CORRECT, 

CORRECT, 


PERCENT 


PERCENT 

PERCENT 

APR 30. 


2 

25 

97 

MAY 18 

1 1.0 

1 

80 

76 

APR 30, 


2 

80 

81 

JUNE 5, 

22.4 

1 

63 

76 

JUNE 24 





APR 30, 


2 

82 

85 

JUNE 5, 

24.0 

1 

80 

76 

JUNE 24 





APR 30. 


2 

79 

83 

JUNE 24. 

24.3 

1 

93 

100 

JULY 29 





GROUND 





TRUTH 

20.3 
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NASAS78 12516 DIGITIZED GROUND TRUTH 
REGISTERED TO LANDSAT IMAGERY 

LACIE SEGMENT 1523, PHASE ID, BLIND SITE 

WILKIN COUNTY, MINNESOTA, 1977 

14 


1 


N ASA-S-78-1 6722 

CROP DEVELOPMENT OBSERVATION FORM 

COUNTY: WM-KIN SEGMENT NUMBER: 1523 

STATE: MINNESOTA SATELLITE PASS DATE: 6 24 77 


FIELD OBSERVATION DATE: 6-24-77 


FIELD 

NUMBER 

PLANT HEIGHT, IN. 

GROUND 

COVER, 

PERCENT 

COMMENTS 

1 

18 

80 - 100 


2 

21 

80 - 100 


3 

22 

80 - 100 


4 

22 

60- 80 


5 



WHEAT DESTROYED; 
RESEEDED SUNFLOWERS 


14 

24 

60- 80 


15 

26 

80 - 100 
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NASA S 78-16723 


<*>•»* 


CLASSIFICATION ACCURACY USING BIOSTAGES 
1.5, 3.5, AND 4.3 FOR SEGMENT 1523 


FIELD NO. 

PERCENT CORRECT 
SMALL GRAIN 

BELOW AVERAGE 1 

64 

2 

68 

5 

20 

6 

95 

9 

98 

AVERAGE 4 

96 

10 

100 

11 

100 

12 

100 

14 

96 

ABOVE AVERAGE 3 

95 

7 

94 

8 

98 

13 

100 

15 

100 
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BLIND SITE EXAMPLE - SITE 1523 

WILKIN COUNTY, MINNESOTA COMPUTER-GENERATED 

CLASSIFICATION MAP 


JULY 29. 1977 

4 . W.. X. * . 


in 

N? 


n jif if 


ii.Ji 

vmws? ia-ii 

r\mk ~'l sura w 





CLASSIFICATION MAP 

BLACK - THRESHOLD 

GREEN - SPRING SMALL 
GRAINS 

ORANGE - NONSPRING 
SMALL GRAINS 
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OMISSION-COMMISSION ERROR RATES FOR 
SMALL GRAINS AND NON-SMALL-GRAINS 

CODE: 


SUBPIXELS CLASSIFIED SMALL GRAINS 
SUBPIXELS GROUND-TRUTH SMALL GRAINS 

SUBPIXELS CLASSIFIED NON-SMALL-GRAIN 
SUBPIXELS GROUND-TRUTH NON-SMALL-GRAINS 


NASA s 78 16726 SCATTER PL0 T OF SEGMENT 1523 

FOR JUNE 24, 1977 SPRING WHEAT 
IN POORLY DRAINED SOIL 


8 r 


11 - 


CHANNEL 14 
2 


1 + 


1 + 


1 


1 1 + 1 I 

11 22+1 
11 112+1 
112 1113 11 + 

112437246 +11 2 

6223437 7+6 5 3 

4 3 4 5 2 4 7 5+5# 3 

451 5382 7*7 #2 4 I 2*1 2 • 

4* 2 1*7 *6 2 3*1 3* 4*2 2 


1 


1 1 1 4 14 2 4*2+8 4 3 1 1 2 1 

l#3 3*4#1 5 S 4+4 5 2 2 21 

1 21332414 2+3 3 3 2 + 3 

l#l 1 I 1 2 3 3+2 I 4 2 1 1 


3 2 

4 13 3 1 

3 2 *2 13 

7*1 2 1 1*1 1* 

#2*3 1 1* 

3 1 1 


1 

2 1 


1 


* *1*2 2122+3 


1 2 1 
1 

1 1 

1 

1 


+2211 
1 1 1+1 
1+111 
111 1 + 
♦ 

1 


2 

1 

I 2 
1 

1 1 


17 


+i 


20 1 ‘ 1 1 

24 38 52 66 80 

CHANNEL 3 
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o* 


MAJOR ERROR SOURCES FOUND IN LACIE 
SMALL GRAINS CLASSIFICATION 

• MISLABELING DUE TO ABNORMAL SIGNATURE DEVELOPMENT 

CAUSED BY 

• LATE PLANTING 

• DROUGHT 

• CATTLE GRAZING (e.g. . OKLAHOMA) 

• CROP ROTATION DROUGHT 

• VARIETY IN PHASE H 

• DISEASE 

• SOIL VARIABILITY 

• OBSERVED OVER LARGE AREAS OF U.S. BUT NOT AS EVIDENT 

IN U.S.S.R. 

• INADEQUACY OF THE LANDSAT SCANNER IN RESOLVING SMALL 

FIELDS (e.g., MONTANA AND NORTH DAKOTA) 

• MISLABELING OF SMALL GRAINS, GRASSES, PASTURE. AND IDLE 

FALLOW WHEN KEY ACQUISITIONS ARE MISSING 

• ONE OR TWO SEGMENTS PER STATE ARE USUALLY AFFECTED 


NASA-S-78-1 6728 


WHEAT SIGNATURE 

VARIABILITY DUE TO DROUGHT 
SEGMENT 1232 KIOWA, OKLAHOMA 
1976 CROP YEAR 


IsiiWAK ' 31 i feuf-Jfik CD*. i 


SO*; ' 1 
''■ssr^aSR-^ > 




i.'-v i i 

. - . 

u \ J u ■■ rm.i* a 


Of ( L 

/4 #'W - 


' .<*. » j-"' 


NOV 24, 1975 


APR 16, 1976 


NUMBER INDICATES BIOWINDOW 
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I’JOR 1 


T<f 


STRIP-FALLOW FIELDS IN MONTANA 


A i» 

OlYl i ’’’ * . .r tl *• V 

i^a .u‘4 JCT"* % : 
r #'«> u 1*11 


u j i i*li 

1ft# 

> v \ m* ; - 

ja mi i . 

»«• \ 7 r 

vva > . . LV i 

. W. W Wrt * 


n A < w 

AUG 8, 1977 


EB3BKUSTANAY, U.S.S.R., SEG 8224 

SPRING WHEAT GROWTH STAGES 
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MAY 3, 1976 - PLANTING 


: 


•Wilt 


. jM? m 

<W M 


J r iWP 

um'.mv »#« 


MAY 4, 1976 - PLANTING 

' ^ 


r 4' «r 4# 
A r V 


ft* J 

JULY 14, 1976 - 
JOINTING TO HEADING 


AUG 1, 1976 - 
HEADING TO TURNING 
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DIGITAL GROUND TRUTH 

• USABLE FOR STUDIES OF ALL LACIE 

DATA RECORDED AT PIXEL LEVEL 

• GROUND TRUTH 

• LANDSAT DATA 

• ANALYST LABELING 

• CLASSIFICATION MAPS 

• CLUSTER MAPS 

• AS WELL AS LACIE DATA RECORDED 

AT THE FIELD LEVEL 

• CROP STAGE DEVELOPMENT 

• YIELD 

• RAINFALL 

• FERTILIZER EFFECTS 

• IRRIGATION EFFECTS 

• SOIL TYPES 

• ATMOSPHERIC OPTICAL DEPTH 


N ASA-S-78-1 6732 


DIGITAL GROUND TRUTH 

• IMPORTANT FOR NON-ACCURACY 
ASSESSMENT ACTIVITIES 

• CLASSIFICATION TECHNIQUE 

DEVELOPMENT 

• SPECTROMET YIELD MODEL 

DEVELOPMENT 

• SPECTROMET CROP DEVELOPMENT 

MODELING 

• NASA SUPPORTING RESEARCH AND 

TECHNOLOGY 
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N AS A-S-78-1 6735 


50 

CoITnTY 40 
SMALL 
GRAINS, i 
PERCENT 20 


-LACIE ESTIMATE IS NOT 
REPRESENTATIVE 
OF THE / 
COUKTYy^ q ^^ 00 

’ O ft 


o o r = 0.56 
0 / SLOPE = 0.33 

/ Y INTERCEPT = 23 12 


PHASE I EXAMPLE 
OF SAMPLING 
ERROR FOUND 
IN NORTH DAKOTA 



60 

- LACIE ESTIMATE 



REPRESENTS / y 


50 

" GROUND TRUTH // 

SEGMENT 

40 


GROUND- 

30 

° cy 

OBSERVED 

° r= 085 

SMALL 

20 

- O/f SLOPE = 0,77 

GRAINS, 

10< 

L INTERCEPT = 6 08 

PERCENT 

16 POINTS 
£Lj i i i — _i i } 


0 10 20 30 40 50 60 70 

LACIE SMALL GRAINS ESTIMATE, PERCENT 
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YIELD ERROR SOURCES 


MEASUREMENT 
ERROR SOURCES 
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NASA-S-78-1 6739 


OBJECTIVE ANALYSIS OF MAY 1977 OKLAHOMA 
PSEUDOZONE PRECIPITATION (IN.) 

USING 147 STATIONS 



NASA-S-78-1 6740 




ANALYSIS OF SAMPLE ERROR 

OKLAHOMA - MAY 1977 PRECIPITATION 

1 


PRECIPITATION 





(IN.) 




CLIMATIC 

OBJECTIVE 

ANALYSIS 

LACIE 

SYNOPTIC 



DISTRICT 

SPARSE 

DENSE 

ANALYSIS 



sc 

4.68 

5.08 

— 



SE 

2 31 

3 10 

— 



NC 

8 05 

9.08 

— 



c 

7.34 

8.13 

— 



wc 

9.01 

10.17 

— 



sw 

7.33 

8.64 

— 



NE 

5.13 

6.02 

“ 



STATE 

7.71 

8.76 

8.90 
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NASA-S-78-1 6741 

OKLAHOMA YIELD MODEL FOR PHASE M 

• OBJECTIVE SELECTION OF VARIABLES BY AA AGREED 

WELL WITH LACIE VARIABLES 

LATENT ROOT LACIE PHASE IE 

VARIABLES SELECTED VARIABLES SELECTED 

OCTOBER PRECIPITATION AUGUST-FEBRUARY PRECIP 

MARCH PRECIPITATION MARCH PRECIP - EVAPOTRANS 

PIRATION 

MAY PRECIPITATION MAY PRECIPITATION 

MAY PRECIPITATION SQUARED 
JUNE PRECIPITATION JUNE PRECIPITATION 

MARCH TEMPERATURE - 

JUNE TEMPERATURE 

MAY DEGREE DAYS ABOVE 90° 

• TECHNOLOGY TREND WAS FOUND TO BE MAJOR SOURCE 

OF ERROR IN THE LACIE ESTIMATES 
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SYSTEM IMPLEMENTATION AND OPERATIONS SESSION 


LACiE AES EFFICIENCY REPORT 
T. White, JSC 
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LACIE AES EFFICIENCY REPORT 


N ASA-S-78-1 6976 


LACIE EFFICIENCY ASSESSMENT 

• OBJECTIVES - MONITOR SYSTEM EFFICIENCY IN 

RELATIONSHIP TO PROJECT GOALS 

- COLLECT INFORMATION FOR DESIGN 

OF FUTURE SYSTEM 

• APPROACH - MONITOR THE OPERATION OF ALL 

SUBSYSTEMS 

- FOCUS ON THROUGHPUT AND TIMELI- 

NESS OF DATA AND PRODUCTS 


167 


m iM INTENTIONALLY. BLANK. 
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SUBSYSTEM TURNAROUND TIME 

AGGREGATION AND REPORTING - 

• PRODUCED TIMELY CROP ASSESSMENT REPORTS ON 

A MONTHLY BASIS 

• 3- TO 7-DAY TURNAROUND TIME 

• UPDATE DATA BASES 

• AGGREGATE AREA AND YIELD ESTIMATES 

® PREPARE NARRATIVE AND PRODUCE REPORT 


NASA-S-78-1 697 8 


SUBSYSTEM TURNAROUND TIME (CONT) 

YIELD 

• PRODUCED TIMELY YIELD ESTIMATES ON A MONTHLY 

BASIS 

• TURNAROUND TIME: 4 DAYS DOMESTIC, 9-12 DAYS 

FOREIGN 

• PROCESS METEOROLOGICAL DATA FROM END-OF- 

MONTH SUMMARY 

• OPERATE YIELD MODELS AND TRANSMIT DATA TO 

JSC 
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SUBSYSTEM TURNAROUND TIME (CONT) 

AREA 

• CONTINUOUS FLOW OF DATA FROM LANDSAT 

• SPECIFIC DATA COLLECTED DEPENDED ON WEATHER 
® 30-DAY NOMINAL TURNAROUND TIME 

• RESOURCE CONSTRAINTS ENCOUNTERED 

• NOMINAL TURNAROUND TIME EXCEEDED 


NASA-S-78-1 6980 


LAC1E DATA/TIME FLOW 



▼ REPORT DATE 

• YIELD ESTIMATE 
PRODUCED 


■ AGGREGATION AND 

REPORT GENERATION 

| CAMS CUTOFF 
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LACIE AVERAGE THROUGHPUT TIME 

• TURNAROUND TIME EXCESSIVE DUE TO BACKLOGS AT 
GSFC AND IN CLASSIFICATION AREA CAUSED BY 
AVERAGE LOAD STAFFING 


PHASE I 


40 DAYS (10-DAY CAMS BACKLOG) 


PHASE H - 33 DAYS ( 4-DAY GSFC BACKLOG) 

PHASE HE - 50 DAYS (12-DAY GSFC BACKLOG AND 

8-DAY CAMS BACKLOG) 


NASA-S-78-1 6982 


LANDSAT ACQUISITIONS RECEIVED AT JSC 


PHASE I PHASE E PHASE EL 


ACQUISITIONS/ 

MONTH 


0 1975 
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GSFC ACQUISITION 
AND EXTRACTION 


LANDSAT DATA PROCESSING TIME LINE 

DAYS 

1 2 3 4 5 6 7 

mm. 


7 DAYS 


JSC 

PREPROCESSING 


6 DAYS 


ANALYST 

PROCESSING 


- 17 DAYS 


WEEKEND OVERNIGHT IN PROCESS 


□ 




6 DAYS 10.7 DAYS 13.3 DAYS 


WEEKEND 


10 11 12 13 14 15 16 17 

1 

WEEKENDS 


N ASA-S-78-1 6986 

NOMINAL THROUGHPUT TIME 

• LAC IE THROUGHPUT TIME FOR ALL PHASES (WITHOUT 
BACKLOGS) WAS APPROXIMATELY 30 DAYS 

• RESULTED FROM MOST COMPONENTS WORKING ONE 

SHIFT 5 DAYS PER WEEK 

• A VERY FRAGMENTED DATA PROCESSING SYSTEM 

• NUMEROUS MANUAL ACTIVITIES 


NOMINAL LAC IE 
PROCESSING TIME GOAL 


GSFC ACQUISITION 



AND EXTRACTION 

7 DAYS 

5 DAYS 

JSC PREPROCESSING 

6 DAYS 

4 DAYS 

ANALYST PROCESSING 

17 DAYS 

5 DAYS 
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EFFICIENCY OBSERVATIONS 

• LAC IE PROCESSING SYSTEM ENCOUNTERED SIGNIFICANT 

INCREASES IN SCOPE, DATA LOAD, AND COMPLEXITY 

• MANY SYSTEM COMPONENTS DID NOT HAVE SIGNIFI- 

CANT INCREASES IN RESOURCES 

• CONSEQUENTLY, SYSTEM EFFICIENCIES WERE 

IMPLEMENTED 

• YIELD ESTIMATION AND PRODUCTION ESTIMATION 

OPERATIONAL GOALS WERE MET WITH IMPLEMENTED 
SYSTEMS 
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EFFICIENCY OBSERVATIONS (CONT) 

• TIMELINESS GOAL FOR AREA ESTIMATION 

WAS NOT ACCOMPLISHED 

• DISPERSIVE SYSTEM 

• MANUAL ACTIVITIES 

• ONE SHIFT/DAY 5 DAYS/WEEK 

• INDICATIONS ARE THAT A CONSOLIDATED/ 

INTERACTIVE DATA PROCESSING SYSTEM 
WITH ADEQUATE RESOURCES COULD 
MEET THE 14-DAY TURNAROUND GOAL 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


DATA PROCESSING SYSTEMS OVERVIEW 
D Hay, JSC 
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DATA PROCESSING SYSTEMS 
IN SUPPORT OF LACIE AND 
FUTURE AGRICULTURAL RESEARCH PROGRAMS 


NASA-S-78-16641 


DATA PROCESSING HIGHLIGHTS 

• IMPLEMENTED THE FIRST COMPLETE DATA SYSTEM TAILORED TO 
LARGE-SCALE AGRICULTURAL INVENTORY USE 



USDA 



NOAA 


NASA 


MULTIAGENCY 

DATA 

ACQUISITION 

SYSTEM 


CROPS 

DATA 

BASE 



IMPLEMENTED 

HIGH- 

VOLUME DATA 
PROCESSING 



ERIPS/l-100 



BENDIX 100 


STARAN 


TESTED 

MAN-MACHINE 

INTERFACES 


PROVED USE 
OF SPECIAL- 
PURPOSE 
HARDWARE 


2AGE i7G 
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DATA SYSTEM TASKS 


USDA 



N ASA-S-78-1 6643 

THE INITIAL SITUATION 


• NO DATA COLLECTION 

PROCEDURES 

• NO LAC IE IMAGERY "SEG- 

MENTS" 

• RUDIMENTARY MET SUM- 

MARIES 

• FEW MAP OR FILM PRODUCTS 


• SMALL-SCALE DATA 

BASES 

• LITTLE CONFIGURATION 

CONTROL 

• LITTLE SYSTEMS INTE- 

GRATION 


• INVESTIGATIVE AREA ESTIMATION TOOLS 

• NO YIELD CAPABILITY 

• NO PRODUCTION CAPABILITY 
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DATA PROCESSING SYSTEM SCOPE 


ORIGINAL SCOPE 

• 2-YEAR PROJECT 

® 8 COUNTRIES 

© 4800 LANDSAT 
SEGMENT CAP- 
ACITY IN 2ND 
YEAR 

• 14-DAY SEGMENT 

THROUGHPUT 

• MONTHLY PRO- 

DUCTION 

REPORTING 

• INTEGRATED 

SYSTEM 
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DATA PROCESSING SYSTEM SCOPE 


ORIGINAL SCOPE 


• 2-YEAR PROJECT 

• 8 COUNTRIES 

• 4800 LANDSAT 

SEGMENT CAP- 
ACITY IN 2ND 
YEAR 

• 14-DAY SEGMENT 

THROUGHPUT 

• MONTHLY PRO- 

DUCTION 

REPORTING 

• INTEGRATED 

SYSTEM 


ISSUES 


• INSUFFICIENT 

LOCAL CA- 
PABILITY 

• LIMITED 

FUNDS 

• LIMITED 

SKILLS 

• LONG IMPLE- 

MENTATION 

SCHEDULES 
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DATA SYSTEM EVOLUTION 

PHASE H (1975-76) 


GSFC HARDLINE I 

STARAN 

AUTOMATED STATUS 
AND TRACKING 

MULTIYEAR 
DATABASES 1 

WMO DATA BASE 

SYNOPTIC MET DATA 

SEMI-INTERACTIVE I 
PROD EST T 


INCREASED FIELD 
STUDY SITES 


LANDSAT-2 RECORDER 
FAILURE 



INCREASED RELIABILITY 

INCREASED THROUGHPUT 

OVERLAPPING CROP YEAR 
PROCESSING ' 

FOREIGN CROP CALENDARS 

MULTICOUNTRY PROD EST 

STUDY ABNORMAL 
SIGNATURES 

BROADER FIELD RESEARCH 
DATA BASES 

DELAYED U.S.S.R. DATA 
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SYSTEM EVOLUTION SUMMARY 


• EXTENSIVE DATACOLLEC 

TION SYSTEM 

• AUTOMATED IMAGERY 

PREPROCESSING 

• WORLDWIDE MET DATA 

• EXTENSIVE PHOTO BASE 

• ADEQUATE MAP BASE 

• PROCEDURE 1 

• CORRELATED DATA SETS 

• TERMINAL ACCESS TO MET 

DATA 

• COMPUTERIZED YIELD AND 

CROP CALENDAR 

• INTERACTIVE PROD EST 

• AUTOMATED AA 


• AUTOMATED DATA BASES 

• AUTOMATED INFO MGT 

• EXTENSIVE CONFIGURA- 

TION CONTROL 

• INTEGRATED PROCEDURES 


n as a-s- 78 -i665i FUTURE SYSTEM SCOPE 

LAC IE INFLUENCE 

• APPLICATIONS RESEARCH SYSTEM 

• INTEGRATED DATA BASE 

• MULTIYEAR DATA RETENTION 

• COMPONENTS TAILORED TO REMOTE 

SENSING 

FUTURE PROGRAM SCOPE 

• MULTICROP ANALYSIS 

• BROADER PARTICIPATION 

• BUDGETS 


TECHNOLOGY UPDATES 

• IMPROVED PROCEDURES 

• SENSOR RESOLUTION 

• LOW-COST ELECTRONICS 

• INCREASED AUTOMATION 


FACILITIES ROLES 

• GSFC SYSTEM MODS 

• DOMSAT 

• CHANGING AGENCY ROLES 


182 



NAS A-S-78-1 6652 


THE R&D DATA SYSTEM TASK 

e R&D DATA BASE MANAGEMENT 

• ALGORITHM IMPLEMENTATION AND TEST 

• LIMITED INTEGRATED TEST 

• SELECTED UNIVERSITY AND INDUSTRY 

DATA AND PROCEDURES INTERFACE 

• TECHNOLOGY TRANSFER 
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FUTURE REMOTE -SENSING 
DATA PROCESSING FUNCTIONS 


CARTO PROCESSOR 


REMOTE 


TERMINALS 


FILM 

RECORDER ' 


PREPROCESSOR 


FORMATTED 

DATA 


( RAW' 
i DATA; 


UNIV SELECTED 
INDUSTRY CONTRACTS 


' LOCAL \ 
. TERMINALS 



- PILOT EXP 

- EXPL EXP 

- STATUS & CONTROL 


CENTRAL 

PROCESSOR 


ARRAY 

PROCESSOR 


STANDARD 
I/O DEVICES 


MASS 

STORAGE 


OFF-LINE 
' STORAGE 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


?N79-14478 


EVOLUTION OF THE EARTH RESOURCES INTERACTIVE 
PROCESSING SYSTEM (ERIPS) 

J Lyon, JSC 


PA5E_^£_JNTENTIQNAU.V bunk. 
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EARTH RESOURCES INTERACTIVE 
PROCESSING SYSTEM 
(LACIE/ERIPS) SYSTEM OVERVIEW 

PRESENTATION OBJECTIVES 

• DEFINITION OF SYSTEM: ITS FUNCTION WITHIN LAC IE 

• DEVELOPMENT SUMMARY: SIGNIFICANT MILESTONES 

• CONVERSION OF ORIGINAL ERIPS TO LAC IE SUPPORT 

• SUBSEQUENT SYSTEM EVOLUTION 

• ESTABLISHMENT OF LAC IE CONTEXT FOR THE THREE 

FOLLOWING ERIPS SUBSYSTEM PRESENTATIONS 

• DATABASES 

• MAN/MACHINE INTERFACES 

• PERIPHERAL PROCESSING 


NASA-S-78-1 6990 



IN LACIE 








LANDSAT 

FULL 

FRAMES 


DATA BASES 
\ 


DISK SOILS, MET. DATA, 
f CROP CALS, ETC 
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NASA-S-78-1 6991 PRE-LACIE ERIPS 

• CONCEPT: INTERACTIVE IMAGE ANALYSIS USING LARGE 

PROCESSOR 

• DEVELOPMENT 

• LARSYS BASELINE - 1971 TO 1973 

• MENU-BASED INTERFACE TO TWO TERMINALS 

• APPLICATIONS MODIFICATIONS AND AUGMENTATIONS 

• DISK-BASED IMAGE STORAGE 

• ONLY RUDIMENTARY BATCH FEATURES 

• CHECKPOINT/RESTART AND ERROR RECOVERY 

• LACIE APPLICABILITY 

• COMPREHENSIVE ANALYSIS FEATURES 

• SCHEDULE MANDATES 

• STRONG EQUIPMENT BASELINE 

• LACIE DEFICIENCIES 

• LIMITED ON-LINE DATA STORAGE 

• INADEQUATE THROUGHPUT 

- NO USEFUL BATCH FEATURES 

- CPU CONSTRAINTS 
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EARLY LACIE SUPPORTING DEVELOPMENT 


• ESTABLISH COMPLETE BATCH SYSTEM 

• MENU-ANALOG CARD INPUTS 

• SUBSET OF INTERACTIVE SYSTEM 

• IMPROVE SYSTEM THROUGHPUT 


• DESIGN AND IMPLEMENT DATA BASES (4+ BILLION BYTES) 


• SIMPLIFY DATA MANAGEMENT PRACTICES 

• PROVIDE OPERATIONAL AND RESEARCH SUPPORT EASILY 

• BUILD GSFC LINKAGE AND SERVICE CONTROL 

• IMPROVE SYSTEM THROUGHPUT 


INTRODUCE NECESSARY APPLICATIONS CHANGES ORIGEl 

e MODIFIED CLASSIFICATION PROCESSING OF Po[ 

• COMPREHENSIVE REPORT AND PRODUCT PREPARATION 


'TAD PAGE IS? 
3R QUALITY! 


• STRENGTHEN SYSTEM INTEGRITY 


NASA-S-78-16994 

ERIPS 

CONFIGURATION 


DIGITAL TV | 
EQUIPMENT F 


- v 


INTERACTIVE 

TERMINALS 






IBM 360-75 J CPU 
AND 4 M BYTES LCS 

ERIPS SUPERVISOR 
_ APPLICATIO NS 
MENU STRUCTURE' 
IDAS 

CHECKPOlNT/RESTARTi 



ON-LINE DISK 
STORAGE 
25 X 10 6 BYTES 
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CONTINUING LACIE DEVELOPMENT 

• ADDITION OF SPECIAL-PURPOSE ARRAY PROCESSOR 

• OFF-LOAD OF PATTERN RECOGNITION FUNCTIONS 

• INCREASE OF SYSTEM THROUGHPUT BY 6 TIMES 

• CONTINUING APPLICATIONS CHANGES 

• PROCEDURE 1 AND RELATED ANALYSIS SOFTWARE 

• STREAMLINING OF PRODUCTION SOFTWARE 


e> _ * 




& 
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ERIPS 

CONFIGURATION 


DIGITAL TV 
EQUIPMENT 


INTERACTIVE 

TERMINALS 


CD 

G3 


IBM 360-75 J CPU 
AND 4 M BYTES LCS 

ERIPS SUPERVISOR 
‘ APPLICATIONS 
MENU STRUCTURE ' 
IDAS 

ICHECKPOINT/RESTART1 



-►PERIPHERALS 
BATCH CARD! 
L .INPUTS- J 


ON-LINE DISK 
STORAGE 
25 x 106 BYTES 
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• TAPE/DISK • COLOR (64) • IMAGE/IMAGE • TRAINING • SPECTRAL 

• GRAY (16) • IMAGE/UTM • FEATURE AIDS 

• SSDA SELECTION • IMAGE MERGE 


• TAPE/DISK • COLOR (64) • IMAGE/IMAGE • TRAINING • SPECTRAL 

• GRAY (16) • IMAGE/UTM • FEATURE AIDS 

• SSDA SELECTION • IMAGE MERGE 

• CLUSTER • IMAGE 

• CLASSIFY, UNLOAD 

ETC © FILM PRO- 

DUCT GEN, 
ETC 
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SUMMARY 


® SUCCESSFUL CONVERSION OF A PRIMARILY INTER- 
ACTIVE TOOL WITH LIMITED THROUGHPUT TO A 
COMPREHENSIVE PRIMARILY BATCH-PRODUCTION 
SYSTEM 

• EXTREME IMPROVEMENT IN SYSTEM CAPACITY DUE 

LARGELY TO PERIPHERAL PROCESSOR 

• HIGHLY RELIABLE SOFTWARE AND PROCEDURES 

HAVE RESULTED IN MINIMAL DATA LOSS AND 
MAXIMUM PRODUCTIVITY 


THREE SIGNIFICANT COMPONENTS OF THIS DEVELOPMENT 
ARE DESCRIBED IN THE FOLLOWING PRESENTATIONS 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


DATA BASE DESIGN CONSIDERATIONS 
L. Westberry, IBM/JSC 
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ERIPS DATA BASES- 
DESIGN CONSIDERATIONS 


NASA-S-78-1 6622 

ERIPS DATA BASES-DESIGN 
CONSIDERATIONS 

• THE ERIPS PROCESSES THAT REQUIRE DATA 

BASES 

• THE IMAGE DATA BASE AS THE CHALLENGE 

• THE DESIGN DECISIONS FOR THE IMAGERY 

DATA BASES 

• CONCLUSIONS 
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WHY DIRECT ACCESS DATA BASES 

• TO PROVIDE TECHNOLOGY DEMONSTRATION AND PROOF 
OF CONCEPT 

• BEFORE ERIPS: 

- BATCH MODE, SINGLE USER WITH TAPE AND CARD 

INPUTS 

,• ERIPS OBJECTIVES 

- MULTIPLE USERS 

- INTERACTIVE (REAL-TIME) DECISION 

- COMPLETE DATA AVAILABILITY 
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ERIPS PROCESSES THAT REQUIRE DATA BASES 


ORDERING 
IMAGE DATA 


RECEIVING 
IMAGE DATA 
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ERIPS PROCESSES THAT REQUIRE 
DATA BASES (CONT) 
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NASA-S-78-1 6628 


IMAGE DATA BASE 
AS THE CHALLENGE 

IMAGE DATA BASE SIZE FIELDS DATA BASESIZE 

94 790 BYTES/ACQ 146 FIELDS/SEGMENT 

x 30 720 ACQ'S x 120 BYTES/FIELD 

2 91 1 948 000 BYTES 17 520 BYTES/FIELD DATA 

+ 340 BYTES - HEADER 

17 860 BYTES/SITE 
x 4 800 SITES 


85 728 000 BYTES 
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IMAGE DATA 

BASE 

AS THE CHALLENGE (CONT) 

HISTORY DATA BASE SIZE 

PROCESS CONTROL 
DATA BASE SIZE 

154 BYTES/SITE - SITE DATA 
+ 28 BYTES/SITE - STRATA 

2-334 BYTES/REQUEST 
x 120 REQUESTS 

182 BYTES OF SITE INFO 
x 4 800 SITES 

280 080 BYTES 

873 600 BYTES 

+ 98 BYTES x 30 720 ACQ'S 


3 884 160 BYTES 
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IMAGE DATA BASE AS THE CHALLENGE 

• CROSS REFERENCING 

• ALLOW INVESTIGATORS TO DETERMINE DATA 

AVAILABILITY 

• CORRELATE ANCILLARY DATA TO IMAGE 

DATA 

• DATA INTEGRITY 

• DATA MUST BE AVAILABLE 

• PROCESSING CONSTRAINTS 

• THROUGHPUT TARGETS OF 120 SEGMENTS PER 

16-HOUR PERIOD 

• COST OBJECTIVES 

• COST EFFECTIVENESS WAS IMPORTANT 
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THE PROBLEM 

• DESIGN AND IMPLEMENT A COST-EFFECTIVE 
DATA BASE STRUCTURE WHICH IS ERROR- 
PROOF TO SUPPORT THE LACIE IN SUCH A 
MANNER AS TO ALLOW ANY GIVEN SEG- 
MENT TO BE PROCESSED IN NO MORE THAN 
8 MINUTES 
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NASA-S-78-1 6633 

DESIGN DECISIONS FOR THE 
IMAGERY DATA BASES (CONT) 

• DATA BASE INTEGRITY CONSIDERATIONS 

• ERROR RECOVERY PROVIDED BY IMS/360 CHECKPOINT/ 
RESTORE UTILITIES 

- CHECKPOINT TIME WAS THE SAME FOR BOTH DESIGNS - 

8.8 HOURS 

- RECOVERY FROM A SINGLE DISK FAILURE (THE MOST 

PROBABLE) 

• 8 8 HOURS FOR THE MULTIPLE-VOLUME INTEGRATED 

DATA BASE 

• 18.6 MINUTES FOR THE MULTIPLE-IMAGE DATA BASE 

DESIGN 
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DESIGN DECISIONS FOR THE 
IMAGERY DATA BASES 

• EXPANDING THE MULTIPLE-IMAGE DATA BASE DESIGN 

• ISOLATE THE APPLICATION PROGRAMS FROM MULTIPLE 

DATA BASES BY USING A MASTER INDEX 

• RANDOMLY DISTRIBUTE THE SITES ACROSS THE DATA 

BASES TO FORCE EVEN LOADING 

• RANDOMLY DISTRIBUTE THE DATA OVER THE TRACKS 

ON EACH DATA BASE 

• OPTIMIZE DATA STORAGE AND RETRIEVAL BY CONSID- 

ERING DEVICE TRACK SIZE, INTERNAL BUFFERING, 
AND PROCESSING LOGIC WHEN ASSIGNING BLOCKING 
FACTORS 
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DESIGN DECISIONS FOR THE 
IMAGERY DATA BASES 

BLOCKING FACTOR - THE SOLUTION 

• TWO DATA SET GROUPS WERE DEFINED TO ALLOW EFFICIENT 
BLOCKING OF IMAGE DATA AND ANCILLARY DATA 



IMAGE 

DATA 


ANCILLARY 

DATA 


IMAGE 

DATA 


IMAGE 

DATA 


ANCILLARY 

DATA 


IMAGE 

DATA 



IMAGE 

DATA 


ANCILLARY 

DATA 


IMAGE 

DATA 



IMAGE DB1 


IMAGE DB 2 


IMAGE D BV 
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BLOCKING FACTOR (CONT) - THE SOLUTION 
• IMAGE DATA BLOCKING 



4 LINES 4 LINES 4 LINES 4 LINES 
OF IMAGE OF IMAGE OF IMAGE OF IMAGE 
DATA DATA DATA DATA 


1 BLOCK 


(6442 BYTES) 


1 BLOCK 


(6442 BYTES) 


1 TRACK 
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DESIGN DECISIONS FOR THE IMAGERY 
DATA BASES 

• IMAGE DATA BLOCKS - INTERNAL 
• THE FIRST STRUCTURE 


y 


LINE 1 LINE 2 LINE 3 1 

1 / 


LINE 117 


V 

A 

LINES 1-4 LINES 5-8 LINES' 9-12 

\r 

LINES 113-117 


ACO'S 1 
THROUGH 
ACQ'S 4 

ACQV 

5«^16 


THIS STRUCTURE MATCHED APPLICATION LOGIC BUT WAS INEFFI- 
CIENT FOR ACQ'S 5 THROUGH 16 


• THE SECOND STRUCTURE 

- ACQUISITIONS 1 THROUGH 4 WERE STORED THE SAME AS 
ACQUISITIONS 5 THROUGH 16 IN THE EARLIER STRUCTURE 


NASA-S-78-16638 

CONCLUSIONS 

IN SUPPORT OF AN INTERACTIVE, MULTIPLE-USER SYSTEM: 

• IMAGE AND ANCILLARY DATA EFFICIENTLY STORED AND 

RETRIEVED 

• THROUGHPUT OBJECTIVES MET 

• DATA LOSSES NEGLIGIBLE 

• DISK SPACE EFFECTIVELY UTILIZED 


THE ERIPS DATA BASES IN CONJUNCTION WITH 
INTERACTIVE PROGRAMING CONCEPTS PROVIDED 
A PROOF-OF-CONCEPT DEMONSTRATION FOR EARTH 
RESOURCES PROCESSING 






' NASA-S-78-1 6639 

FUTURE CHALLENGES 

• NEW LANDSAT'S 

• MORE SENSORS AND HIGHER RESOLUTION MEAN 

MORE DATA FOR ANALYSTS 

• NEW APPLICATIONS 

• AIR QUALITY, LAND USE, WATER QUALITY, ETC , 

MEAN MORE ANALYSTS NEEDING ACCESS TO DATA 

• PROBLEMS TO BE SOLVED 

• DATA STORAGE ON A GLOBAL SCALE FOR: 

- LANDSAT'S, SEASAT'S 

- SOIL MOISTURE SATELLITES 

- GEOLOGY APPLICATION SATELLITES 

• DATA DISTRIBUTION 

• POSSIBLE SOLUTIONS 

• MASS STORAGE DEVICES 

• DISTRIBUTED DATA BASES 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


MAN-MACHINE INTERFACE IN LAC IE ERIPS 
B. Duprey, IBM/JSC 
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NAS A-S-78-1 6552 

MAN-MACHINE INTERFACES IN LACIE/ERIPS 



• MENUS 

• ERROR RECOVERY 

» CHECKPOINT/RESTART 
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MAN-MACHINE INTERFACES 


• INTERACTIVE MENUS 

• WHAT THEY ARE 

• WHY WE CHOSE THEM 

• HOW THEY ARE USED 

• WHAT THEY COST 

♦ NONINTERACTIVE USE OF MENUS 

• WHY BATCH MODE WAS NEEDED 

• HOW IT IS USED 

• WHAT IT COST 
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MAN-MACHINE INTERFACES (CONI) 


• ERROR RECOVERY 

• WHY IT IS NEEDED 

• WHAT IT DOES 

• WHAT IT COSTS 

• CHECKPOINT/RESTART 

• WHY IT IS NEEDED 

• WHAT IT DOES 

• WHAT IT COSTS 

• CONCLUSIONS 

• WHAT WE LEARNED 

• WHAT WE WOULD CHANGE 


N ASA-S-78-1 6555 



• THE PROBLEM 

• ALLOW INTERACTIVE USERS AT 

ALL LEVELS OF EXPERIENCE 
TO COMMUNICATE PRODUC- 
TIVELY WITH THE COMPUTER 

• OUR SOLUTION 

• MENUS 
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• ADVANTAGES 

• TUTORIAL -CAN BE USED WITHOUT 

EXTENSIVE TRAINING 

• MODULAR -EASILY MODIFIED AS 

SYSTEM CHANGES 

• PROTECTIVE -PROVIDES SYSTEM 

INTEGRITY 

• DISADVANTAGES 

• MANY REQUIRED INTERACTIONS 

• FRONT-END COST HIGH 

• COST IN LACIE/ERIPS 

• 30 000 LINES OF CODE (12.5 PERCENT) 


NASA-S-78-1 6557 

ITERATIVE INITIALIZATION MENU 

INPUT YOUR ITERATIVE PARAMETERS: 


DEFAULT <L 

R2 


CO _ 

NMIN2 


PERCENT 

ITMAX 


SEP 

P OF N 

• 

STDMAX 

MATCH THRS 


DLMIN 

SPLIT/COMBINE SEQUENCE 

□ WL2 n 

1 ' MATCH 1 1 

L1 □ 
MATCH 1 1 

L2 

MATCH 


STARTING VECTORS: 


| SELF GENERATING VECTORS 
SUBCLASS STATISTICS VECTORS 
VECTORS FROM RUN NUMBER 
EXTERNAL VECTORS 
DOTS AS STARTING VECTORS 
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CLUSTERING MENU TREE 
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• ADVANTAGES 

• HANDLES LARGE WORKLOAD 

• EASY TO USE 

• PROVIDES ACCURATE REPETITION FOR 

COMPARISONS 

• FREES PERSONNEL FOR OTHER WORK 

• DISADVANTAGES 

• SOME FLEXIBILITY LOST 

• FRONT-END COST 

• COST IN LACIE/ERIPS 

• 10 500 LINES OF CODE (4.5 PERCENT) 



211 



N ASA-S-78-1 6562 


• ADVANTAGES 

• AVOIDS REWORK - REESTABLISHES 

PREVIOUS ENVIRONMENT 

• AUTOMATIC .-USER NEED NOT BE 

CONCERNED WITH MECHANICS OF 
THE PROCESS 

• NOT IMPACTED BY OTHER USER 

• DISADVANTAGES 

• COST IN LACIE/ERIPS 

• 2400 LINES OF CODE (1 PERCENT) 


NASA-S-78-16563 


- *\ 

* * 


• THE PROBLEM 

• BE FORGIVING OF 
HUMAN ERROR 


• OUR SOLUTION 
• ERROR RECOVERY 


0 

OOPS! 
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• ADVANTAGES 

• AVOIDS REWORK-SYSTEM IS RETURNED 

TO MOST RECENT GOOD STATUS 

• DOES NOT IMPACT OTHER USER 

• ALLOWS WORK TO CONTINUE 

IMMEDIATELY 

• DISADVANTAGE 

• SOMETIMES MAKES PROBLEM INVESTI- 
. GATION DIFFICULT 

• COST IN LACIE/ERIPS 

• 1200 LINES OF CODE (0.5 PERCENT} 
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IF WE WERE DOING IT NOW 

• MENUS WOULD STILL BE A GOOD CHOICE 

• WE WOULD CONTINUE TO SUPPORT BOTH INTERACTIVE 

AND NONINTERACTIVE USERS 

© MORE TERMINALS, PROBABLY WITH MORE LOCAL 
INTELLIGENCE, WOULD BE SUPPORTED 

• AN INTERACTIVE USER WOULD BE ABLE TO SPECIFY 

WHEN BATCH MODE ASSUMPTIONS APPLY 

• ERROR RECOVERY AND CHECKPOINT/RESTART WOULD 

BE MAINTAINED, EXTENDED TO MORE TERMINALS 

• TIE-IN TO USER TRIAL ALGORITHMS WOULD BE PROVIDED 
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SUMMARY 


• MENUS PROVIDE USERS AT ALL LEVELS OF EXPERIENCE WITH 

THE CAPABILITY TO COMMUNICATE PRODUCTIVELY WITH 
THE COMPUTER 

• ERROR RECOVERY REDUCES THE IMPACT OF SERIOUS ERRORS 

TO ALMOST NOTHING 

• CHECKPOINT/RESTART ALLOWS AN ENVIRONMENT SET UP AT ONE 

TIME TO BE USED AT ANOTHER WITHOUT REWORK 

• THE LESSONS WE HAVE LEARNED CAN BE USED TO STRENGTHEN 

STILL FURTHER THE COMMUNICATION BETWEEN MAN AND 
MACHINE 


214 




DATA PROCESSING SYSTEMS DESIGN SESSION 


VERY HIGH SPEED PROCESSING AS RELATED TO 
PIXEL-DEPENDENT TASKS 
J. Lyon, JSC 




N ASA-S-78-1 6605 


VERY-HIGH-SPEED PROCESSING: 
APPLICABILITY OF PERIPHERAL DEVICES 
TO PIXEL-DEPENDENT TASKS 

PROBLEM STATEMENT 
LOCAL EXPERIENCE 
PROGNOSIS 


NASA-S-78-1 6606 


THE IMAGE PROCESSING ENVIRONMENT 

• OPERATIONAL ENVIRONMENT MAY INCLUDE COMPONENTS OF 

• RESEARCH AND TEST 

• PRODUCTION • 

• TECHNOLOGY TRANSFER 

• SYSTEMS ENVIRONMENT CHARACTERIZED BY MAJOR SIGNIFI- 

CANCE OF 

• DATA MANAGEMENT 

- MANIPULATION OF AND TRAFFIC CONTROL FOR (MANY) 

LARGE DATASETS 

• PIXEL PROCESSING 

- REPETITIVE, INDEPENDENT, OR AGGREGATIVE COMPUTA- 

TIONS 

• RADIOMETRIC AND GEOMETRIC CORRECTIONS 

• TRAINING 

• UNSUPERVISED CLASSIFICATION 

• SUPERVISED CLASSIFICATION 

• FILTERING 

• PIXEL PROCESSING CAN DOMINATE CONVENTIONAL SERIAL 

DEVICES 
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MAXIMUM LIKELIHOOD CLASSIFICATION 

• OBJECTIVE- MINIMIZE 

H C (X) « S c + 1/2<X -m c > T A^ (X -p c ) 

FOR C CLASSES AND N-CHANNEL STATISTICS 

• THE REQUIRED NUMBER OF ARITHMETIC OPERATIONS IS GIVEN BY- 

ADDS (N2 + 2N + 1IC PER VECTOR 


MULTIPLIES- 1/2(N 2 + 3N)C 
• FOR REPRESENTATIVE CASES 


N 


PER VECTOR 
PER VECTOR 



4 

4 

16 

16 

K3 

20 

10 

20 

I 

500 

Gl 

5780 

140 1 

280 

1 1520 1 

3040 



INNER-LOOP OPERATIONS PER SAMPLE SEGMENT APPROACH OR EXCEED 109 


NASA-S-78-1 6608 


IBM 360-75 MAXIMUM LIKELIHOOD PERFORMANCE 

JUNE 1973 

IMAGE CONTAINING L LINES, P PIXELS/LINE, N CHANNELS, WITH C CLASSES 
COMPUTED TIMINGS FOR LACIE SEGMENTS (SECONDS) 


PROCESS 

TIME,j,isec 

C-10, 
N - 4 

C = 20, 
N = 4 

C= 10, 
N - 16 

C - 20, 
N = 16 

SYSTEM OVERHEAD 

3000L 

0 351 

0 351 

0.351 

0 351 

DATA MOVEMENT 

(6 49N + 8 82) LP 

.797 

.797 

2 583 

2 583 

GEN STATS 

5 03 C 2 LP 

11 535 

46140 

11 535 

46140 

QUADRATIC FORM 

[7 46 + N{4N 
+ 16 21)] CLP 

31 256 

62 512 

296 010 

592 020 

STORE BEST Q 

2 92 CLP 

700 

1 400 

700 

1400 

STORE BEST C 

5 9 LP 

135 

.135 

135 

.135 

TOTAL 

44 780 

111 335 

311 314 

642 629 

PERCENT IN QUADRATIC FORM 

70 

56 

95 

92 


(PURE COMPUTE) 
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LACIE THROUGHPUT PROJECTION 


4800-SEGMENT PROJECT IMPLIED UP TO 
60 HOURS/DAY OF IBM 360-75 TIME 
IN PEAK GROWING SEASON 


ORIGINAL PA01 !§' 
OF BQOR QUAKCT 


NASA-S-78-1 6610 


PROCESSING ALTERNATIVES 

I INCREASED THROUGH- I 
■<. PUT OR PROCESSING 
REQS 


. PAGE 
QE ?00R QUAZJ3 


CONVENTIONAL SERIAL PROCESSOR 




SOFTWARE CHANGE 


COMPUTATIONAL 

IMPROVEMENTS 

• RUNNING TESTS 

• VECTOR CLASS 

• SYSTEM IMP 


APPROXIMATIONS 



SIMPLIFICATIONS 

• CHANNEL REDUCTION 

• INTELLIGENT PRE- 

PROCESSING 


EQUIPMENT CHANGE 


LARGER 

MAINFRAME 


SPECIAL 

HARDWARE 


MAKE BUY 


DIVISION OF LABOR 
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PROGRAMMABLE PERIPHERAL 
HIGH-SPEED PROCESSORS 

• GENESIS IN SEISMIC AND RADAR SIGNAL REDUCTION 

• ALL APPLIED IN SOME FORM TO SIGNAL-PROCESSING 

PROBLEMS 

• ARCHITECTURES 

• PARALLEL 

• PIPELINED 

• ARRAY 

• DISTRIBUTED'LOAD SHARING 

• RANGE OF CAPABILITY UP TO SEVERAL x 10 8 MFLOPS 

(10 x 10 9 ANTICIPATED) 

• ARITHMETIC BOTH FIXED AND FLOATING POINT 

• PRICE RANGES FROM $50K TO $10M+ 


NASA-S-78-1 661 2 


HIGH-SPEED PROCESSORS 

EXAMPLES 


• 

iLLiAcnz: 

IBM 3838, 2938, ASP 

• 

GOODYEAR STARAN B AND E 

ESL ASAP 

• 

FPS AP120B AND AP190L 

GE IMAGE 100 

• 

CDC MAP IH AND FP 

(BURROUGHS SCIENTIFIC 
* PROCESSOR) 

• 

CSPI MAP 300 

{GSFC MASSIVELY 
PARALLEL PROCESSOR) 


AND OTHERS 

* 






NASA-S-78-16613 


EXISTING LACIE/ERIPS FACILITY 


DRAFT TERMINALS 
(BLDG 30) 


DIGITAL 
TELE- 
VISION 
EGUIP- 
' MENT 


DRAFT TERMINALS 
(BLDG 17) 


4M-BYTE 
LARGE CORE 
(EXTENDED) 
STORAGE _ 

IBM 360-75J 
(1M-BYTE 
MAIN CORE 
STORAGE) 


PDP 11-20 
CONTROL 
PROCESSOR 


STANDARD 

PERIPHERALS 


ON-LINE DISK STORAGE 
(8 2314’$) 


GAC S-500 
STARAN 

PARALLEL 

PROCESSOR 


ON-LINE DATA BASES 
(42 ITEL 7330’S) 


NASA-S-78-16614 


STARAN 

LOAD CLASSIFICATION 
PROGRAM TO PAGES 


LOAD STATISTICS 
IN BULK CORE (<65K) 


LOAD DATA IN BULK. 
CORE (20K BYTES) 



ALGORITHM EXECUTION SPP MAXIMUM LIKELIHOOD 


COMPUTE IN ARRAYS 
<C,E) 


INTERFACE CONTROL 


RECORD - 

CONSTANTS 

RECORD 

IMAGE DATA 


RECORD 


CLASSIFIED IMAGE 


DATA RECORD 

i 

OUTPUT PARAMETER 


RECORD 


360-75 AND DISKS 

USER APPLICATION 
INPUTS 


STATISTICAL 

MANIPULATIONS 


IMAGE DATA 
RETRIEVAL AND 
REFORMATTING 
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LACIE THROUGHPUT IMPROVEMENTS 

• ASSUMING 40 CLASSES PER SEGMENT 

• SPP PERFORMANCE OF STATS, ITCLUS, MIXDEN 


TIME (SEC) PER SEGMENT 


NO OF CHANNELS 

360 75 

WITH SPP 

RATIO 

ONLY SPP TASKS 

4 

386 

201 

1 92 

36 

8 

921 

260 

3 54 

7 5 

12 

1941 

323 

6 00 

13 25 

16 

2738 

396 

6 91 

14 8 


• WITHOUT SPP, AT PEAK PHASE HI, ABOUT 40 

HR/DAY OF 360-75 WOULD HAVE BEEN 
REQUIRED FOR SEGMENT PROCESSING 

• WITH SPP, ABOUT 8 HR/DAY WERE REQUIRED 

FOR SAME TASKS 

• MULTITEMPORAL OPERATION JUSTIFIES SPECIAL- 

PURPOSE PROCESSOR 
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ATS ORGANIZATION 


OPERATOR 

CONSOLE 


POP 

11-70 VE 


ANALYST 

STATION 



NASA-S-78-1 S61 8 


AES/ATS PERFORMANCE COMPARISONS 
EQUIVALENT SPP TASKS 

• PROCESS TOPOLOGY IS CRUCIAL TO SPECIAL-DEVICE PERFORMANCE 

• CODING PROBLEMS ARE OFTEN CONCEPTUALLY DIFFERENT 

• API 20 TIME DOMAIN (PIPELINE) 

• STARAN- SPACE DOMAIN (ARRAY) 



TASK 

IBM 3'60/STAR AN 

PDP 11-70/AP120 B 

512 x 512 MAXLIK 

41 SEC 


4 CHAN, 8 CLASSES 

56 SEC 

117 x 196 ITCLUS 



4 CHAN , 30 CLASSES 

8 SEC 

18 SEC 

(PERPASS) 





223 








NASA-S'78-1 6619 


FUTURE PROCESSING TRENDS 
APPLICABILITY OF PERIPHERAL DEVICES 


o LANDSAT-D: EQUIVALENT GROUND COVERAGE IMPLIES A SEVEN- 
FOLD INCREASE OVER LANDSAT-3 USING THEMATIC MAPPER 

• MUTUAL REGISTRATION OF DIFFERENT SENSORS SUGGESTS SIG- 

NIFICANT INCREASE IN PREPROCESSING VOLUME TRANSCEND- 
ING CURRENT LEVELS BY SIGNIFICANT FACTORS 

• ANALYSIS FLOW TRENDS TOWARD MORE COMPLEX USES OF DATA 

• SYSTEM REORGANIZATIONS TO EXPLOIT PERIPHERAL PROCESSORS 

IN THE SOLUTION OF DATA MANAGEMENT PROBLEMS ARE 
REQUIRED 

• DEVELOPMENTOFEFFICIENT HIGH : LEVEL LANGUAGES AND 

CONVENIENT LIBRARY MODULES MUST CONTINUE 


N ASA-S-78-1 6620 

PROPOSED EARTH RESOURCES FACILITY 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


THE CARTOGRAPHIC LABORATORY 
M Rader, Lockheed/JSC 


Original pflotograpfiy may Be gurcBasea frorm 
EROS Data Center 

Sioux Falls, SD 5"*)( *) y 
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CARTOGRAPHY - LACIE’S 
SPATIAL PROCESSOR 


N ASA-S-78-1 6784 

LACIE PROCESS FLOW 


PRODUCTION 



RESEARCH, TEST, AND EVALUATION 
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TRANSITION FROM PHOTOGRAPHIC 

TO 

DIGITAL IMAGE PROCESSING 

• CONCEPTUAL DIFFERENCES 

• SKILLS PROBLEMS 

• HARDWARE OBSOLESENCE 


NASA-S-78-1 6786 

THE CARTOGRAPHIC ROLE IN LACIE 

• TEST SITE SELECTION 

• MEASURING LACIE PERFORMANCE 

• LACIE RESEARCH, YIELD ANALYSIS, 

AND PHOTOINTERPRETATION 
GRAPHIC AIDS 
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BLIND SITE FIELD 
ANNOTATIONS 


AERIAL PHOTOS 


- SAMPLE 
SEGMENT 
SITE 


GROUND 

TRUTH 

TAPE 


ANNOTATED 

OVERLAYS 
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BLIND SITE EXAMPLE - SITE 1523 

WILKIN COUNTY, MINNESOTA 
FIELD DELINEATIONS • CARTOGRAPH LAB 




'1 \ .’A - YT>* 


^ t \.P 


j NASA S 78 12521 

DIGITIZED GROUND TRUTH 

REGISTERED TO LANDSAT IMAGERY . 1 

LACIE 

SEGMENT 1523, PHASE HI, BLIND SITE 


WILKIN COUNTY, MINNESOTA 

1 

w* 


1 

lk 

't i La j?1 

l 


jd* t 



j-- ii * 


1 

r^' - JBl _«•? ’ 

1 


i ’pcnop. i 



i i 



s-'* i ~ 

a 


. V mi 

i 


^ X ' V.1L1I 

9 

— mW0 



INVENTORY DATE, AUGUST 1, 1977 
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BLIND SITE EXAMPLE - SITE 1523 

WILKIN COUNTY, MINNESOTA COMPUTER-GENERATED 
CLUSTER AND CLASSIFICATION MAPS 


AUGUST 17, 1977 

V. 


CONDITIONAL CLUSTER MAP 

BLACK - THRESHOLD, DO, DU 
YELLOW - NONSPRING SMALL GRAINS 
GREEN - SPRING SMALL GRAINS 
OTHER • CONDITIONAL CLUSTERS 


v •* ; 
\ , t 


, v 


NASA-S-78-16791 


OTHER SUPPORT 
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FUTURE CARTOGRAPHIC SYSTEM 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


SOME COST PERFORMANCE CHARACTERISTICS OF 
SEVERAL DATA SYSTEM CONFIGURATIONS FOR 
PROCESSING REMOTELY SENSED DATA 
P. Gregor, MITRE Corporation 
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SOME COST-PERFORMANCE CHARACTERISTICS OF 
SEVERAL DATA SYSTEM CONFIGURATIONS 

FOR 

PROCESSING REMOTELY SENSED DATA 

THE MITRE CORPORATION 
HOUSTON, TEXAS 


NASA-S-78-1 6761 


BACKGROUND 


• TREND TOWARD LARGE REMOTE-SENSING DATA SYSTEMS 

BECAUSE OF 

• SUCCESSFUL EXPERIENCE 

• COMPUTER TECHNOLOGY IMPROVEMENTS - MORE POWER, 

LOWER PRICE 

• LARGE VOLUMES OF DATA 

• NASA JSC 

• PLANNING FOR NEW DATA SYSTEM TO SUPPORT CONTINU- 

ING POST- LAC IE R&D & QUASI-OPERATIONAL REMOTE- 
SENSING ACTIVITIES 

• CONSIDERING CONSOLIDATION OF LACIE DATA SYSTEM 


237 


BIAS® 
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N ASA-S-78-1 6764 


OVERVIEW 

OBJECTIVE 

EXPLORE SEVERAL ALTERNATIVE 



APPROACHES TO CONSTRUCTING A 
LARGE REMOTE-SENSING DATA 
SYSTEM FOR JSC 

PROCEDURE. 


1) 

IDENTIFY DATA SYSTEM USAGE 

2) 

PROPOSE HARDWARE ALTERNATIVES 

3) 

IDENTIFY COST ITEMS 

4) 

EVALUATE COST-EFFECTIVENESS 


NASA-S-78-1 6765 


DATA SYSTEM USAGE 
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N AS A-S-78-1 6766 


MAPPING ACTIVITIES TO RESOURCES 


PROJECTS 


RESOURCES 




• FORESTRY 

• COASTAL 

• AGRICULTURAL 

• ETC 


EARTH RESOURCES/ 
REMOTE-SENSING 
FUNCTIONS 


• GP COMPUTER 

• SPP 

• ALPHANUMERIC 

• TERMINAL 

• IMAGE STATION 

• ETC 






NASA-S-78-1 6767 


MEASUREMENT OF WORK AND RESOURCES 


• GOAL QUANTIFY WORK IN TERMS COMPARABLE TO EQUIPMENT 

CAPABILITIES 

• MEASURES' 

• TERMINALS AND'IMAGE STATIONS 

- TIME PERSON WILL REQUIRE DEVICE; i.e./ "CONNECT HOUR" 

• SPECIAL-PURPOSE PROCESSORS 

- TIME A PARTICULAR MODEL WILL BE USED, i.e , "CONNECT 

HOUR" 

• GENERAL-PURPOSE PROCESSORS 

- WEIGHTED SUM OF CPU TIME, I/O ACTIVITY, AND MEMORY 

UTILIZATION (AUTOMATICALLY CALCULATED BY MOST 
OPERATING SYSTEMS, e.g., SRU OF CONTROL DATA 
CORPORATION, SUP-Hr OF UNIVAC), i.e., "RESOURCE UNIT" 
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FY77 SYSTEM USAGE MATRIX 


FY77 JSC EOD DATA SYSTEM USAGE - WEEKLY AVERAGE DURING PEAK PERIOD 


RESOURCE 


ACTIVITY 


SOFTWARE DEVELOPMENT 
& QUALITY ASSURANCE 


SYSTEM SUPPORT 
LACIE PRODUCTION 



RESOURCE 

UNITS 


IMAGE 

TERMINAL 


STARAN 

CONNECT CONNECT CONNECT 
HR HR HR 





NASA-S-78-1 6769 


FORECAST SYSTEM USAGE 


• EXACT PROJECTION OF USAGE DIFFICULT 

• VARIABLE PROGRAM SCOPES 

• ALGORITHM/PROCEDURE OPTIONS 

• UNCERTAIN IMPACT OF DATA VOLUME 

• FOUR POSSIBLE PER-WEEK PEAK USAGE LEVELS 

IDENTIFIED 

A - 200 GP RESOURCE UNITS 
B - 250 GP RESOURCE UNITS 
C -300 GP RESOURCE UNITS 
D - 400 GP RESOURCE UNITS 
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DATA SYSTEM ARCHITECTURE 










N ASA-S-78-1 6772 



N AS A-S-78-1 6773 

BUS-ORIENTED MULTIPLE-MACHINE ARCHITECTURE 
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HARDWARE ALTERNATIVES 



NASA-S-78-1 6775 


DATA SYSTEM COSTS 
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DATA SYSTEM COST ITEMS 

ONE TIME COSTS 

• HARDWARE PURCHASE AND DEVELOPMENT 

• SYSTEM SOFTWARE PURCHASE AND DEVELOPMENT 

• APPLICATIONS SOFTWARE DEVELOPMENT AND CON- 

VERSION 

• FACILITY MODIFICATIONS 

• COMMUNICATIONS INSTALLATION 

• TRAINING 

• PROCUREMENT AND SYSTEM ENGINEERING SUPPORT 

• SYSTEM INTEGRATION AND TEST 


NASA-S-78-1 6777 

DATA SYSTEM COST ITEMS (CONT) 

RECURRING COSTS 

• HARDWARE MAINTENANCE 

• SOFTWARE LEASE 

• OPERATIONS, INCLUDING SYSTEM 

MANAGEMENT AND SUPPORT SERVICES 

• COMMUNICATIONS 

• CONSUMABLES 
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NAS A-S-78-1 6779 

SELECTED COST ITEMS (PART I ) 

• HARDWARE PURCHASE AND MAINTENANCE 

• INFORMATION FROM VENDORS 

• IN GENERAL ANNUAL MAINTENANCE COSTS WERE 

- 5% OF PURCHASE PRICE FOR LARGE MAINFRAMES 

- 10-15% FOR MINICOMPUTERS 

• SOFTWARE CONVERSION 

• DIFFICULT BECAUSE 

- VARIETY OF LANGUAGES 

- VARIETY OF MACHINES 

- AGE OF SOME SOFTWARE (TIED TO OLD EQUIPMENT) 

• COST COULD EXCEED $3 MILLION ($6 TO $7 PER LINE) 

- COMPARES WITH OTHER GOVERNMENT EXPERIENCE 

($2 TO $7 PER LINE) 


NAS A-S-78-1 6778 


SELECTED COST ITEMS (PART E) 
OPERATIONS PERSONNEL 


TAPE , 
LIBRARY 


DATA 

ENTRY 


TERMINAL 

CONTROL 


PRODUCTION 

VGMT 


^ 1 

(WORKFLOW! 

^ 'I V y 

^PLQT^RS^ | 


""N /^supvr^x! 

f TRAINING ) 

operators) ( &ADM ) 

• V ) 


OPS SYSTEM PERFORMANCE \ CATIONS 

DEV & MAINT ANALYSIS 
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COST EFFECTIVENESS 


NASA-S-78-1 6781 


LIFE CYCLE COSTS 

IN FY78 (SIOOO'S) 


ORIGINAL PAGE IS 
@g gOOR QUALITY, 


SYSTEM 

ARCHITECTURE 

INITIAL 

COST 

ANNUAL 

M&O 

10 YR COST 


AOR B 

9 000 

1417 

23170 

SINGLE 

COR D 

9 870 

1537 

25 240 


>D 

10 500 

1575 

26 250 


A 

7 870 

1481 

22 580 

MULTIPLE 

B 

8 320 

1528 

23 600 


C 

8 680 

1712 

25 800 


D 

9 490 

1841 



A 

8 980 

1620 

25180 

MULTIPLE 

B 

9 460 

1688 

26 340 

WITH BUS 

C 

9 850 

1851 

28 360 


D 

10 720 

1980 

30 520 


c IN COMPARISON, FY77 DATA SYSTEM COSTS WERE $3 164 OCO 
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CONCLUSIONS 


• FINDINGS 

• ALL SYSTEMS CONSIDERED WOULD BE BETTER THAN 

CURRENT SYSTEM 

- QUANTITATIVELY (CAPACITY, THROUGHPUT) AND 

- QUALITATIVELY (UNIFIED OPERATIONS, EASE OF USE) 

• NEW SYSTEM DEVELOPMENT COSTS RECOVERED IN LOWER 

OPERATING COSTS 

• RECURRING COSTS SLIGHTLY FAVOR SINGLE MACHINE 

ARCHITECTURE 

• RECOMMENDATION TO JSC 

• CONSOLIDATE DATA PROCESSING AND ESTABLISH SINGLE- 

MACHINE SYSTEM 

• GENERALIZATION- 

• IN A DIFFERENT SITUATION, OTHER FACTORS MAY INFLUENCE 

A FINAL CHOICE 

- SOFTWARE CONVERSION COST 

- REQUIRED APPROVAL CYCLE 

- FLEXIBILITY 

- ETC 
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DATA PROCESSING SYSTEMS DESIGN SESSION 


N 79 - 1 


EQUIPMENT SELECTION CRITERIA FOR R&D 
IMAGE PROCESSING 
E. Poole, IBM/JSC 
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A LOOK AT COMPUTER SYSTEM 
SELECTION CRITERIA 

PRESENTED AT 
1978 LACIE SYMPOSIUM 


SESSION: DATA PROCESSING 
SYSTEMS DESIGN 


NASA-S-78-1 7000 


OUTLINE 

} 1. INTRODUCTION 

2. CONFIGURATION ADEQUACY 

3. EVALUATION RATING 

4. SUMMARY 
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PROBLEM DEFINITION 

• SELECTION OF A COMPUTER SYSTEM TO SOLVE A 

PARTICULAR PROBLEM IS A COMPLEX TASK 

• COMPARISON OF VARIOUS SYSTEMS1S DIFFICULT 

• THIS OFTEN RESULTS IN SELECTION OF THE WRONG 

SYSTEM 

THERE IS A NEED FOR A FORMALIZED SYSTEM SELECTION 
PROCESS BASED ON QUANTIFIABLE CRITERIA 


N AS A-S-78-1 7002 

PROPOSED SOLUTION 

IBM FSD-HOUSTON HAS DEVELOPED A FORMALIZED 
EVALUATION PROCESS (MODEL) WHICH CONSIDERS 
THE FOLLOWING SET OF GENERIC'SELECTION 
CRITERIA 

• ADEQUACY 

• COST 

• ADAPTABILITY 

• AVAILABILITY 

• TRANSPORTABILITY 

• USABILITY 
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SYSTEM SELECTION PROCESS 



NASA-S-78-17004 


OUTLINE 

1. INTRODUCTION 
| 2. CONFIGURATION ADEQUACY 

3. EVALUATION RATING 

4. SUMMARY 
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NASA-S-78-17005 


STEP I 

CONFIGURATION ADEQUACY 


DEFINE 

CANDIDATE 

CONFIG 


MODIFY 
CANDIDATE 
CONFIG OR 
WORKLOAD 


USER 

SYSTEM 

REQUIRE- 

MENTS 


POTENTIAL 

CONFIG 

SOLUTIONS 


CALCULATE 

SYSTEM 

LOADING 


/CONFIG\ 

.ADEQUATE?. 



NASA-S-78-17006 


WORKLOAD DEFINITION EXAMPLE 


FUNCTION 


RESOURCE DEFINITION VARIABLES 


CLASSIFICATION 


CPU. 608 000 + (NO. FIELDS) x (45 000 
+ (NO SUBCLASSES) x (42 500 
+ (NO. CHANNELS) x 2500) ) 

MEMORY 16 700 + 80 x (NO. FIELDS) 

1/0: 46 250 + 22 932 x (NO. CHANNELS) 

+ 240 x (NO. SUBCLASSES) 

+ (NO. FIELDS) x (20 x (NO. SUB- 
CLASSES) ) 
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NASA-S-78-17007 

WORKLOAD DEFINITION EXAMPLE 


PROCESS 1 - CLUSTERING ALGORITHM RESEARCH 



BENCHMARK A (PEAK LOAD) 
2P + 8P 3 + 21P 4 + 6P 8 + . . 


BENCHMARK B (AVERAGE LOAD) 
P 1 + 3P 2 + 6P3 + 15P 5 + . . . 
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NASA-S-78-1 7009 


STEP H 

EVALUATION RATING 



NASA-S-78-1 7010 

USER-SPECIFIC SELECTION CRITERIA 
FOR AN EARTH RESOURCES DATA SYSTEM 

FOR EACH TECHNICALLY ADEQUATE CONFIG EVALUATE: 

• COST 

• INITIAL DEV COSTS (NONRECURRING) 

• OPS COSTS (RECURRING - 10-YR LIFE CYCLE) 

• CONFIG FLEXIBILITY 

• EXPERIMENTAL FLEXIBILITY 

• NEW TECHNIQUE/TECHNOLOGY EVAL FLEXIBILITY 

• EASE OF TECHNOLOGY ACCESS 

• TECHNOLOGY TRANSFER 

• RELEVANCE TO USER REQS 

• TRANSITION AND OPS COSTS 

• SUPPORT TECH TO AID NEW USER 

• CONFIGURATION USABILITY 

• USER PRODUCTIVITY 

• EVOLUTIONARY DEV CAPABILITY 

• OPS ACCEPTABILITY 

• SCHEDULES 

• TIMELY DEV SUPPORT 

• PLANABLE CONFIG EXPANSION 
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NASA-S-78-1701 1 

EXAMPLE 

CRITERIA CATEGORIES FOR 
EARTH RESOURCES DATA SYSTEMS 


CRITERIA CATEGORY 

WEIGHT, 

PERCENT 



1. COST (10-YR LIFECYCLE) 

1 



2. INTERACTIVE SUPPORT CAPABILITIES 

toil 



• OVERALL SYSTEM ARCHITECTURE 

40 



• EXPANDABILITY 

20 



• AVAI LABILITY/MAINTAINABI LITY 

40 



3. GENERAL SUPPORT CAPABILITIES 

30 



• OPERATIONAL MANAGEMENT AND 




FLEXIBILITY 

50 



• EXPANDABILITY 

30 



• TRANSPORTABILITY OF TECHNOLOGY 

20 



NASA-S-78-1701 2 

EXAMPLE OF CRITERION RATING 


CRITERION 

WEIGHT, 

PERCENT 

RATING 



GENERAL SUPPORT CAPABILITIES 

30 




• OPERATIONAL MANAGEMENT AND 





FLEXIBILITY 

50 




A. EXPERIMENTAL FLEXIBILITY 

25 




- SUPPORT HIGH-LEVEL LANGUAGES ’ 


9 



- EASY ADDITION OF NEW PROGRAMS 


5 



- TRANSFER PROGRAMS/DATA TO/ 





FROM REMOTE LOCATIONS 


2 



- EASE CREATION OF NEW DATA SETS 


8 



- REMOTE SOURCE CODE EDITION 


5 



- REMOTE JOB INITIATION 


5 



- SUPPORT MULTI-USERS SIMUL- 





TANEOUSLY 


8 



- TERMINAL CONTROL PROGRAM 





B 
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NASA-S-78-17013 


OUTLINE 

1. INTRODUCTION 

2. CONFIGURATION ADEQUACY 

3. EVALUATION RATING 
} 4. SUMMARY 


NASA-S-78-17014 

SUMMARY 

CURRENT STATUS 

• CONCEPTS DEFINED 

• VALIDATION IN PROCESS 

• INVESTIGATING WEAK AREAS 
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SUMMARY 


CONCLUSIONS 


• FORMALIZATION OF THE COMPUTER SYSTEM SELECTION 

PROCESS IS FEASIBLE 

• NASA MAY USE THE MODEL TO EVALUATE CONFIGURA- 

TIONS PROPOSED BY VARIOUS VENDORS 

• VENDORS MAY USE THE MODEL TO HELP DETERMINE 

THE BEST SYSTEM TO PROPOSE 

• COMPUTER IMPLEMENTATION OF THE MODEL IN A 

LANGUAGE SUCH AS APL IS A RELATIVELY SIMPLE 
TASK 
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